00000001:02000400:1.0F:1782480584.323011:0:2965:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_hostid 00000001:02000400:3.0F:1782480605.116636:0:3186:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local 00000001:01000000:3.0:1782480607.240423:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 411 MB/s 00000001:01000000:2.0F:1782480607.491829:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 289 MB/s 00000001:01000000:1.0:1782480607.742609:0:3229:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 1703 MB/s 00000020:02000000:1.0:1782480608.561258:0:3278:0:(class_obd.c:804:obdclass_init()) Lustre: Build Version: 2.17.54_98_g3a728b9 00000400:02000000:1.0:1782480610.297513:0:3293:0:(api-ni.c:2752:lnet_startup_lndni()) Added LNI 192.168.201.158@tcp [8/256/0/180] 00008000:02000000:3.0:1782480614.429165:0:3443:0:(echo_client.c:2573:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1782480671.621644:0:5249:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1782480680.710379:0:5782:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782480680.710384:0:5782:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1782480680.710470:0:5782:0:(super25.c:130:lustre_fill_super()) VFS Op: sb 00000000554e7526 00000080:02000400:1.0:1782480680.710478:0:5782:0:(super25.c:154:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:1.0:1782480680.716546:0:5782:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:1.0:1782480680.716567:0:5782:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:0.0F:1782480680.717189:0:5782:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (000000004fba6b5c) 00000020:00000080:0.0:1782480680.717218:0:5782:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782480680.729460:0:5782:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1782480680.729730:0:5782:0:(scrub.c:229:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1782480680.751622:0:5782:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1782480680.751746:0:5782:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782480680.751771:0:5782:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1782480680.751818:0:5782:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782480680.751843:0:5782:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1782480680.752246:0:5782:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782480680.752254:0:5782:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782480680.752267:0:5782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf4dae 00000020:01000004:2.0:1782480680.752276:0:5782:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782480680.752280:0:5782:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782480680.753523:0:5782:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000554e7526 from MGS 00000020:01000004:2.0:1782480680.753530:0:5782:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782480680.753554:0:5782:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000001f9361b0) 00000020:00000080:2.0:1782480680.753567:0:5782:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782480680.753760:0:5782:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000554e7526 from MGS, refs=2 00080000:01000000:2.0:1782480680.753767:0:5782:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782480680.753773:0:5782:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf4dbc 00000100:00100000:2.0:1782480680.753898:0:5782:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782480680.755375:0:5782:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782480680.755384:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1782480680.756364:0:5782:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1782480680.756374:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1782480680.757548:0:5782:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782480680.758436:0:5782:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1782480680.758446:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1782480680.761248:0:5782:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1782480680.761259:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:3.0:1782480680.763305:0:5782:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:3.0:1782480680.763317:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1782480680.765029:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480680.765033:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480680.765035:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480680.766279:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480680.766283:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480680.766289:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480680.770610:0:5782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1782480680.773138:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1782480681.019890:0:5782:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 2103 MB/s 00000001:01000000:0.0:1782480681.269889:0:5782:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 3187 MB/s 00000001:01000000:2.0:1782480681.521746:0:5782:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 539 MB/s 00000001:01000000:3.0:1782480681.771994:0:5782:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 503 MB/s 00080000:10000000:1.0:1782480681.795823:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000040:01000000:1.0:1782480681.833957:0:5782:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:1.0:1782480681.833979:0:5782:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1782480681.833982:0:5782:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00010000:00010000:0.0:1782480681.834962:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782480681.835907:0:5793:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1782480681.835994:0:5782:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1782480681.836064:0:5782:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:0.0:1782480681.836590:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1782480681.836620:0:5782:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1782480681.837412:0:5782:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480681.837614:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1782480681.837623:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:1.0:1782480681.845967:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:1.0:1782480681.845982:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1782480681.857110:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1782480681.857128:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1782480681.858482:0:5782:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1782480681.858510:0:5782:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.158@tcp' 00000020:01000004:2.0:1782480681.858512:0:5782:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1782480681.858567:0:5782:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.158@tcp (typ=mgc) 00000020:00000080:2.0:1782480681.858582:0:5782:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.158@tcp (000000008f90d565) 00000020:00000080:2.0:1782480681.858611:0:5782:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1782480681.858730:0:5782:0:(ldlm_lib.c:102:import_set_conn()) imp 000000004126937a@MGC192.168.201.158@tcp: add connection 192.168.201.158@tcp at head 00010000:00010000:2.0:1782480681.858918:0:5782:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.158@tcp-0 is initialized 00000040:01000000:2.0:1782480681.858925:0:5782:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 1 is initialized 00000100:00080000:1.0:1782480681.860258:0:5798:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:0.0:1782480681.860817:0:5799:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782480681.860870:0:5782:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.158@tcp (uuid 58b05c0b-51b3-47cf-95bc-f3947e9ac894) 00000020:00000080:0.0:1782480681.860896:0:5782:0:(genops.c:1406:class_connect()) connect: client 58b05c0b-51b3-47cf-95bc-f3947e9ac894, cookie 0x4776e02a9acf4dca 00000100:00080000:0.0:1782480681.860911:0:5782:0:(import.c:512:import_select_connection()) MGC192.168.201.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782480681.860918:0:5782:0:(import.c:626:import_select_connection()) MGC192.168.201.158@tcp: import 000000004126937a using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1782480681.860976:0:5782:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000591509bf x1869066388111488/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782480681.861006:0:5782:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 58b05c0b-51b3-47cf-95bc-f3947e9ac894->MGS 00000020:01000004:0.0:1782480681.861029:0:5782:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782480681.861035:0:5782:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782480681.861051:0:5782:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000065286a90) 00000020:00000080:0.0:1782480681.861064:0:5782:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:3.0:1782480681.862792:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000591509bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3309:1869066388111488:0@lo:250: 00000100:00100000:3.0:1782480681.862961:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480681.863130:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388111488 00000100:00100000:3.0:1782480681.863139:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388111488 00000100:00100000:3.0:1782480681.863189:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480681.863195:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000d73792c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1869066388111488:12345-0@lo:250: 00010000:00080000:3.0:1782480681.863219:0:5794:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 58b05c0b-51b3-47cf-95bc-f3947e9ac894@0@lo t0 exp 0000000000000000 cur 212 last 0 00000020:00000080:3.0:1782480681.863247:0:5794:0:(genops.c:1406:class_connect()) connect: client 58b05c0b-51b3-47cf-95bc-f3947e9ac894, cookie 0x4776e02a9acf4dd8 00000100:00080000:3.0:1782480681.863389:0:5794:0:(import.c:65:import_set_state_nolock()) 00000000c1f79d30 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782480681.863439:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000d73792c6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:3309:x1869066388111488:12345-0@lo:250: Request processed in 243us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480681.863446:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480681.863493:0:3309:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:3.0:1782480681.863501:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.158@tcp: connect to target with instance 0 00000100:00080000:3.0:1782480681.863509:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:3.0:1782480681.863514:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:3.0:1782480681.863524:0:3309:0:(import.c:65:import_set_state_nolock()) 000000004126937a MGS: changing import state from CONNECTING to FULL 10000000:01000000:3.0:1782480681.863526:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:3.0:1782480681.863538:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:3.0:1782480681.863543:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000591509bf pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3309:1869066388111488:0@lo:250: 00000100:00100000:0.0:1782480681.880143:0:5782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480681.880335:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782480681.880341:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1782480681.884078:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1782480681.884095:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1782480681.884872:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1782480681.884880:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1782480681.886099:0:5782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480681.886719:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1782480681.886727:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:2.0:1782480681.893064:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:2.0:1782480681.893096:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1782480681.958471:0:5782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480681.959065:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1782480681.959072:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1782480681.960926:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1782480681.960952:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1782480681.966577:0:5782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480681.966950:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1782480681.966957:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1782480681.972295:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1782480681.972313:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:1.0:1782480681.982928:0:5782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480681.983111:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782480681.983117:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:1.0:1782480681.983986:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782480681.983994:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1782480681.984882:0:5782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480681.985030:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1782480681.985035:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:1.0:1782480681.985591:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:1.0:1782480681.985597:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782480682.011551:0:5782:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480682.011944:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782480682.011951:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1782480682.013062:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782480682.013072:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1782480682.014513:0:5782:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1782480682.014523:0:5782:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1782480682.015929:0:5782:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1782480682.015961:0:5782:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1782480682.015969:0:5782:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1782480682.016112:0:5782:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782480682.016149:0:5782:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20065 00000020:01000004:0.0:1782480682.016154:0:5782:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782480682.016156:0:5782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782480682.016158:0:5782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480682.016159:0:5782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480682.016160:0:5782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480682.016162:0:5782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480682.016163:0:5782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782480682.016164:0:5782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782480682.016166:0:5782:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480682.016167:0:5782:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480682.016169:0:5782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480682.016170:0:5782:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782480682.016177:0:5782:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:0.0:1782480682.016180:0:5782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782480682.016181:0:5782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782480682.016182:0:5782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480682.016183:0:5782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480682.016184:0:5782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480682.016185:0:5782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480682.016186:0:5782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782480682.016187:0:5782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782480682.016188:0:5782:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480682.016189:0:5782:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480682.016190:0:5782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480682.016191:0:5782:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782480682.016225:0:5782:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782480682.016242:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000074a6c3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388111616:0@lo:253: 00000100:00100000:0.0:1782480682.016316:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480682.016411:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 00000000ad4047bf going to sleep for 11 seconds 00000100:00100000:1.0:1782480682.016470:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388111616 00000100:00100000:1.0:1782480682.016478:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388111616 00000100:00100000:1.0:1782480682.016578:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480682.016587:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000021fbec63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:5782:x1869066388111616:12345-0@lo:253: 20000000:01000000:1.0:1782480682.016629:0:5797:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782480682.016632:0:5797:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1782480682.017062:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1782480682.017123:0:5797:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1782480682.017385:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782480682.018261:0:5819:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:1.0:1782480682.018502:0:5797:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1782480682.018506:0:5797:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:1.0:1782480682.018511:0:5797:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:1.0:1782480682.018514:0:5797:0:(mgs_llog.c:3603:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:1.0:1782480682.018527:0:5797:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:1.0:1782480682.018718:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480682.018957:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:1.0:1782480682.018971:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1782480682.019015:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:1.0:1782480682.019055:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:1.0:1782480682.019104:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:1.0:1782480682.019189:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:1.0:1782480682.019198:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:1.0:1782480682.019258:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:1.0:1782480682.019267:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:1.0:1782480682.019299:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:1.0:1782480682.019306:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:1.0:1782480682.019335:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:1.0:1782480682.019377:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:1.0:1782480682.019405:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:1.0:1782480682.019409:0:5797:0:(mgs_llog.c:3163:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:1.0:1782480682.019422:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480682.019614:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:1.0:1782480682.019624:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1782480682.019687:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:1.0:1782480682.019725:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:1.0:1782480682.019772:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:1.0:1782480682.019790:0:5797:0:(mgs_llog.c:3120:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:1.0:1782480682.019876:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:1.0:1782480682.019886:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:1.0:1782480682.019931:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:1.0:1782480682.019970:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:1.0:1782480682.020016:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:1.0:1782480682.020027:0:5797:0:(mgs_llog.c:3085:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:1.0:1782480682.020116:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:1.0:1782480682.020126:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:1.0:1782480682.020157:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:1.0:1782480682.020190:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:1.0:1782480682.020352:0:5797:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:1.0:1782480682.020402:0:5797:0:(mgs_llog.c:3300:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:1.0:1782480682.020410:0:5797:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1782480682.021441:0:5820:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1782480682.022186:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1782480682.022210:0:5797:0:(mgs_llog.c:3346:mgs_write_log_mdc_to_lmv()) add nid 192.168.201.158@tcp for mdt 20000000:01000000:0.0:1782480682.022212:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:0.0:1782480682.022244:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1782480682.022252:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1782480682.022281:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1782480682.022290:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:0.0:1782480682.022351:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1782480682.022363:0:5797:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1782480682.022393:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1782480682.022428:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1782480682.022486:0:5797:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782480682.022489:0:5797:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1782480682.022500:0:5797:0:(mgs_llog.c:5063:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1782480682.022507:0:5797:0:(mgs_llog.c:1376:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1782480682.023252:0:5821:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1782480682.023362:0:5797:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1782480682.031613:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1782480682.031719:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1782480682.031808:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1782480682.031828:0:5797:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1782480682.031831:0:5797:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1782480682.031835:0:5797:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1782480682.031858:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782480682.031861:0:5797:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782480682.031890:0:5797:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782480682.031893:0:5797:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782480682.032575:0:5822:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1782480682.032948:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1782480682.032985:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1782480682.033039:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 20000000:01000000:1.0:1782480682.033052:0:5797:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782480682.033054:0:5797:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782480682.033406:0:5823:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:0.0:1782480682.033600:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:0.0:1782480682.033642:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:0.0:1782480682.033913:0:5797:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:0.0:1782480682.033930:0:5797:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782480682.033933:0:5797:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:0.0:1782480682.033939:0:5797:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1782480682.033959:0:5797:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.033975:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.033985:0:5797:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.033992:0:5797:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.034009:0:5797:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.034016:0:5797:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.034021:0:5797:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000044bdd471 already unused, calling callback (00000000a5b936b3) 00010000:00010000:0.0:1782480682.034025:0:5797:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.034032:0:5797:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.034044:0:5797:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.034051:0:5797:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.034056:0:5797:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000044bdd471/0x4776e02a9acf4ddf lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782480682.034074:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782480682.274059:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000021fbec63 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:5782:x1869066388111616:12345-0@lo:253: Request processed in 257464us (257733us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480682.274081:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480682.274196:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000074a6c3aa pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388111616:0@lo:253: 10000000:01000000:1.0:1782480682.274210:0:5782:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1782480682.274214:0:5782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1782480682.274216:0:5782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1782480682.274217:0:5782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782480682.274218:0:5782:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1782480682.274219:0:5782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782480682.274220:0:5782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782480682.274221:0:5782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1782480682.274223:0:5782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1782480682.274224:0:5782:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1782480682.274226:0:5782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782480682.274233:0:5782:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1782480682.274253:0:5782:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000554e7526 from lustre-MDT0000 10000000:01000000:1.0:1782480682.274289:0:5782:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1782480682.274292:0:5782:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1782480682.274297:0:5782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91d7c2d04d40 10000000:01000000:1.0:1782480682.274302:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782480682.274309:0:5782:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91d7c2d04d40 from 1 10000000:01000000:1.0:1782480682.274313:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782480682.274357:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000febbb246/0x4776e02a9acf4de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.274367:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000febbb246/0x4776e02a9acf4de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.274376:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000febbb246/0x4776e02a9acf4de6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480682.274394:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000067993afd pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388111744:0@lo:101: 00000100:00100000:1.0:1782480682.274450:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.274506:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 000000000c859984 going to sleep for 11 seconds 00000100:00100000:3.0:1782480682.274642:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388111744 00000100:00100000:3.0:1782480682.274648:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388111744 00000100:00100000:3.0:1782480682.274719:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480682.274727:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000bc052de9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:5782:x1869066388111744:12345-0@lo:101: 00010000:00010000:3.0:1782480682.274740:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480682.274752:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000bf637f8f/0x4776e02a9acf4ded lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4de6 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480682.274773:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000bf637f8f/0x4776e02a9acf4ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4de6 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480682.274782:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000bf637f8f/0x4776e02a9acf4ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4de6 expref: 6 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480682.274790:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000bf637f8f, rc 0) 00000100:00100000:3.0:1782480682.274830:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000bc052de9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+6:5782:x1869066388111744:12345-0@lo:101: Request processed in 104us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480682.274846:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480682.274909:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000067993afd pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388111744:0@lo:101: 00010000:00010000:0.0:1782480682.274921:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000febbb246/0x4776e02a9acf4de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.274930:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000febbb246/0x4776e02a9acf4de6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480682.274984:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000071257a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388111872:0@lo:501: 00000100:00100000:0.0:1782480682.275012:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480682.275037:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 000000009ad993c1 going to sleep for 11 seconds 00000100:00100000:2.0:1782480682.275092:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388111872 00000100:00100000:2.0:1782480682.275096:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388111872 00000100:00100000:2.0:1782480682.275122:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782480682.275127:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003e5e95d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+6:5782:x1869066388111872:12345-0@lo:501: 00000100:00100000:2.0:1782480682.275367:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003e5e95d4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+6:5782:x1869066388111872:12345-0@lo:501: Request processed in 240us (355us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782480682.275375:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480682.275710:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000071257a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388111872:0@lo:501: 10000000:01000000:0.0:1782480682.275731:0:5782:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1782480682.275748:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000febbb246/0x4776e02a9acf4de6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.275756:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000febbb246/0x4776e02a9acf4de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480682.275763:0:5782:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d7c52cd800 10000000:01000000:0.0:1782480682.275767:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782480682.275771:0:5782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91d7c52cd800 10000000:01000000:0.0:1782480682.275773:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:0.0:1782480682.275776:0:5782:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff91d7c52cd800 from 1 10000000:01000000:0.0:1782480682.275778:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:0.0:1782480682.275794:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 0000000044bdd471/0x4776e02a9acf4df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.275800:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 0000000044bdd471/0x4776e02a9acf4df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.275807:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 0000000044bdd471/0x4776e02a9acf4df4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480682.275817:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000071257a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112000:0@lo:101: 00000100:00100000:0.0:1782480682.275859:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480682.275882:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 000000009ad993c1 going to sleep for 11 seconds 00000100:00100000:1.0:1782480682.276044:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388112000 00000100:00100000:1.0:1782480682.276059:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388112000 00000100:00100000:1.0:1782480682.276091:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782480682.276097:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f9dc11df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+6:5782:x1869066388112000:12345-0@lo:101: 00010000:00010000:1.0:1782480682.276105:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480682.276114:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007e050edf/0x4776e02a9acf4dfb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4df4 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.276129:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007e050edf/0x4776e02a9acf4dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4df4 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.276148:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007e050edf/0x4776e02a9acf4dfb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4df4 expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.276155:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007e050edf, rc 0) 00000100:00100000:1.0:1782480682.276190:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f9dc11df pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+7:5782:x1869066388112000:12345-0@lo:101: Request processed in 94us (331us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480682.276196:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480682.276381:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000071257a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112000:0@lo:101: 00010000:00010000:0.0:1782480682.276391:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 0000000044bdd471/0x4776e02a9acf4df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.276399:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 0000000044bdd471/0x4776e02a9acf4df4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480682.276410:0:5782:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:0.0:1782480682.276425:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 0000000044bdd471/0x4776e02a9acf4df4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.276431:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 0000000044bdd471/0x4776e02a9acf4df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480682.276437:0:5782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1782480682.276441:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782480682.276445:0:5782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91d7c52cd800 10000000:01000000:0.0:1782480682.276447:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:0.0:1782480682.276450:0:5782:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:0.0:1782480682.276451:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782480682.276465:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 000000000e70df5c/0x4776e02a9acf4e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.276471:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 000000000e70df5c/0x4776e02a9acf4e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.276478:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 000000000e70df5c/0x4776e02a9acf4e02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480682.276495:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000071257a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112128:0@lo:101: 00000100:00100000:0.0:1782480682.276520:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480682.276541:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 000000009ad993c1 going to sleep for 11 seconds 00000100:00100000:2.0:1782480682.276623:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388112128 00000100:00100000:2.0:1782480682.276627:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388112128 00000100:00100000:2.0:1782480682.276656:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782480682.276695:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000004868d338 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+7:5782:x1869066388112128:12345-0@lo:101: 00010000:00010000:2.0:1782480682.276702:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480682.276710:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000e9b2301d/0x4776e02a9acf4e09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4e02 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480682.276723:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000e9b2301d/0x4776e02a9acf4e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4e02 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480682.276741:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000e9b2301d/0x4776e02a9acf4e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4e02 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480682.276747:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000e9b2301d, rc 0) 00000100:00100000:2.0:1782480682.276775:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000004868d338 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+8:5782:x1869066388112128:12345-0@lo:101: Request processed in 82us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480682.276781:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480682.277310:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000071257a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112128:0@lo:101: 00010000:00010000:0.0:1782480682.277322:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 000000000e70df5c/0x4776e02a9acf4e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.277329:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 000000000e70df5c/0x4776e02a9acf4e02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480682.277374:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000071257a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112256:0@lo:501: 00000100:00100000:0.0:1782480682.277401:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480682.277428:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 000000009ad993c1 going to sleep for 11 seconds 00000100:00100000:3.0:1782480682.277485:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388112256 00000100:00100000:3.0:1782480682.277490:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388112256 00000100:00100000:3.0:1782480682.277522:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480682.277527:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000f5dff663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+8:5782:x1869066388112256:12345-0@lo:501: 00000100:00100000:3.0:1782480682.277799:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000f5dff663 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+9:5782:x1869066388112256:12345-0@lo:501: Request processed in 271us (397us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480682.277815:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782480682.277841:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000071257a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112256:0@lo:501: 00000100:00100000:0.0:1782480682.277867:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000071257a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112384:0@lo:503: 00000100:00100000:0.0:1782480682.277902:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480682.277931:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 000000009ad993c1 going to sleep for 11 seconds 00000100:00100000:3.0:1782480682.279863:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388112384 00000100:00100000:3.0:1782480682.279877:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388112384 00000100:00100000:3.0:1782480682.279936:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782480682.279944:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000001bbd5650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+9:5782:x1869066388112384:12345-0@lo:503: 00000100:00100000:3.0:1782480682.280190:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000001bbd5650 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+9:5782:x1869066388112384:12345-0@lo:503: Request processed in 247us (2287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480682.280198:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1782480682.280360:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000071257a3e pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112384:0@lo:503: 00000100:00100000:3.0:1782480682.280935:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000e9610961 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5826:1869066388112512:0@lo:502: 00000100:00100000:3.0:1782480682.280979:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480682.281014:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set 00000000bf512caf going to sleep for 11 seconds 00000100:00100000:1.0:1782480682.281148:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388112512 00000100:00100000:1.0:1782480682.281153:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388112512 00000100:00100000:1.0:1782480682.281185:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782480682.281191:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000cb79136d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+9:5826:x1869066388112512:12345-0@lo:502: 00000100:00100000:1.0:1782480682.281354:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000cb79136d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+9:5826:x1869066388112512:12345-0@lo:502: Request processed in 163us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480682.281360:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782480682.281440:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000e9610961 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5826:1869066388112512:0@lo:502: 00000020:01000000:0.0:1782480682.281460:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480682.281470:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480682.281473:0:5826:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782480682.281477:0:5826:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1782480682.281480:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782480682.281493:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000008ead244f) 00000020:00000080:0.0:1782480682.281507:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1782480682.281518:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1782480682.281587:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1782480682.281593:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf4e17 00000020:00000080:0.0:1782480682.281852:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1782480682.281856:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480682.281860:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480682.281861:0:5826:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782480682.281863:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480682.281867:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480682.281868:0:5826:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1782480682.281871:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782480682.281878:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000099b896d9) 00000020:00000080:0.0:1782480682.281886:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1782480682.281890:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1782480682.281891:0:5826:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1782480682.281893:0:5826:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1782480682.281898:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782480682.281943:0:5826:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000554e7526 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1782480682.281962:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b649faed) 00000020:00000080:0.0:1782480682.281970:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1782480682.282017:0:5826:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1782480682.282021:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4776e02a9acf4e2c 00000020:00000080:1.0:1782480682.287237:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:1.0:1782480682.287250:0:5826:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:1.0:1782480682.287261:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4776e02a9acf4e33 00080000:01000000:1.0:1782480682.287329:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:1.0:1782480682.287335:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf4e3a 00080000:10000000:1.0:1782480682.288969:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1782480682.289822:0:5826:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:1.0:1782480682.295405:0:5826:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1782480682.383531:0:5826:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:2.0:1782480682.389053:0:5826:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:2.0:1782480682.399087:0:5826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:2.0:1782480682.399407:0:5826:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1782480682.484634:0:5826:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (000000001b035377) 00000020:00000080:2.0:1782480682.484655:0:5826:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1782480682.484753:0:5826:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:2.0:1782480682.484759:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf4e48 00000020:00000080:3.0:1782480682.491511:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1782480682.494754:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480682.585244:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480682.686326:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480682.721455:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480682.765808:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480682.810733:0:5826:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1782480682.845705:0:5826:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4776e02a9acf4e4f 00000020:00000080:3.0:1782480682.846174:0:5826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1782480682.846185:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480682.846191:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480682.846194:0:5826:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1782480682.846197:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480682.846204:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480682.846205:0:5826:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1782480682.846209:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1782480682.846248:0:5826:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1782480682.846261:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480682.846264:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480682.846265:0:5826:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1782480682.846267:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480682.846270:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480682.846271:0:5826:0:(obd_config.c:1561:class_process_config()) marker 9 (0x1) lustre sys.timeout 00000020:00000080:3.0:1782480682.846274:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1782480682.846280:0:5826:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1782480682.846382:0:5826:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000029f909c6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5826:1869066388112640:0@lo:502: 00000100:00100000:3.0:1782480682.846519:0:5826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480682.846568:0:5826:0:(client.c:2701:ptlrpc_set_wait()) set 000000003cb55e4f going to sleep for 11 seconds 00000100:00100000:1.0:1782480682.846626:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388112640 00000100:00100000:1.0:1782480682.846634:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388112640 00000100:00100000:1.0:1782480682.846700:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782480682.846708:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000001971541d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+9:5826:x1869066388112640:12345-0@lo:502: 00000100:00100000:1.0:1782480682.846998:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000001971541d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+9:5826:x1869066388112640:12345-0@lo:502: Request processed in 291us (480us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480682.847005:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782480682.847052:0:5826:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000029f909c6 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5826:1869066388112640:0@lo:502: 00000020:01000000:1.0:1782480682.847074:0:5826:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480682.847078:0:5826:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480682.847080:0:5826:0:(obd_config.c:1561:class_process_config()) marker 9 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782480682.847082:0:5826:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:1.0:1782480682.847185:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:1.0:1782480682.847202:0:5782:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782480682.847216:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 000000000e70df5c/0x4776e02a9acf4e02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.847226:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 000000000e70df5c/0x4776e02a9acf4e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480682.847235:0:5782:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91d7c52cd800 from 1 10000000:01000000:1.0:1782480682.847238:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782480682.847262:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.847269:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.847277:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480682.847289:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000013bcfca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112768:0@lo:101: 00000100:00100000:1.0:1782480682.847807:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.847848:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 000000008adae256 going to sleep for 11 seconds 00000100:00100000:3.0:1782480682.847951:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388112768 00000100:00100000:3.0:1782480682.847956:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388112768 00000100:00100000:3.0:1782480682.847989:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782480682.847996:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000d2cc14c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+9:5782:x1869066388112768:12345-0@lo:101: 00010000:00010000:3.0:1782480682.848006:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480682.848017:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007ad6be1b/0x4776e02a9acf4e5d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4e56 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480682.848037:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007ad6be1b/0x4776e02a9acf4e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4e56 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480682.848047:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007ad6be1b/0x4776e02a9acf4e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4e56 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480682.848055:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007ad6be1b, rc 0) 00000100:00100000:3.0:1782480682.848094:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000d2cc14c1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+10:5782:x1869066388112768:12345-0@lo:101: Request processed in 100us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480682.848100:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782480682.848182:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000013bcfca7 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112768:0@lo:101: 00010000:00010000:2.0:1782480682.848194:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480682.848202:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480682.849069:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000754351b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112896:0@lo:256: 00000100:00100000:2.0:1782480682.849125:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480682.849154:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 0000000053b454f0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480682.849237:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388112896 00000100:00100000:1.0:1782480682.849242:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388112896 00000100:00100000:1.0:1782480682.849267:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480682.849272:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c61945d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+10:5782:x1869066388112896:12345-0@lo:256: 20000000:01000000:1.0:1782480682.849287:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1782480682.849292:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1782480682.849485:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c61945d7 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+10:5782:x1869066388112896:12345-0@lo:256: Request processed in 211us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480682.849491:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480682.849523:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000754351b4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388112896:0@lo:256: 10000000:01000000:1.0:1782480682.850256:0:5782:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782480682.850273:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.850282:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480682.850290:0:5782:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c52cd800 from 1 10000000:01000000:1.0:1782480682.850292:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782480682.850819:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480682.850926:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.850936:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.850945:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480682.850967:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113024:0@lo:101: 00000100:00100000:1.0:1782480682.851025:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.851091:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eee0bbf3 going to sleep for 11 seconds 00000100:00100000:0.0:1782480682.851134:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388113024 00000100:00100000:0.0:1782480682.851142:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388113024 00000100:00100000:0.0:1782480682.851221:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782480682.851227:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ea5f5acd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+10:5782:x1869066388113024:12345-0@lo:101: 00010000:00010000:0.0:1782480682.851237:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480682.851249:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000086beafca/0x4776e02a9acf4e6b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4e64 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.851277:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000086beafca/0x4776e02a9acf4e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4e64 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.851285:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000086beafca/0x4776e02a9acf4e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4e64 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.851293:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000086beafca, rc 0) 00000100:00100000:0.0:1782480682.851339:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ea5f5acd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:5782:x1869066388113024:12345-0@lo:101: Request processed in 113us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480682.851345:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480682.851409:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113024:0@lo:101: 00010000:00010000:1.0:1782480682.851421:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.851428:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480682.851474:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113152:0@lo:501: 00000100:00100000:1.0:1782480682.851497:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.852016:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eee0bbf3 going to sleep for 11 seconds 00000100:00100000:3.0:1782480682.852079:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388113152 00000100:00100000:3.0:1782480682.852085:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388113152 00000100:00100000:3.0:1782480682.852112:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782480682.852117:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000afe9f316 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:5782:x1869066388113152:12345-0@lo:501: 00000100:00100000:3.0:1782480682.853300:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000afe9f316 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:5782:x1869066388113152:12345-0@lo:501: Request processed in 1178us (1798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480682.853320:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782480682.853526:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113152:0@lo:501: 00000100:00100000:1.0:1782480682.853569:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113280:0@lo:503: 00000100:00100000:1.0:1782480682.853774:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.853862:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eee0bbf3 going to sleep for 11 seconds 00000100:00100000:0.0:1782480682.853896:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388113280 00000100:00100000:0.0:1782480682.853903:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388113280 00000100:00100000:0.0:1782480682.853945:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782480682.853953:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000000c3f207d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:5782:x1869066388113280:12345-0@lo:503: 00000040:00080000:0.0:1782480682.853997:0:5797:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782480682.854043:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000000c3f207d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:5782:x1869066388113280:12345-0@lo:503: Request processed in 91us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480682.854049:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782480682.854154:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113280:0@lo:503: 00000040:00080000:2.0:1782480682.855237:0:5830:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:1.0:1782480682.855548:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:1.0:1782480682.855567:0:5782:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782480682.855587:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.855598:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480682.855849:0:5782:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782480682.855853:0:5782:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d7c52cd800 10000000:01000000:1.0:1782480682.855865:0:5782:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d7c52cd800 10000000:01000000:1.0:1782480682.855868:0:5782:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782480682.855874:0:5782:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d7c52cd800 from 1 10000000:01000000:1.0:1782480682.855877:0:5782:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782480682.855910:0:5782:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000f2d68526/0x4776e02a9acf4e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.855917:0:5782:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000f2d68526/0x4776e02a9acf4e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.855926:0:5782:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000f2d68526/0x4776e02a9acf4e72 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480682.855948:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113408:0@lo:101: 00000100:00100000:1.0:1782480682.856004:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.856137:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eee0bbf3 going to sleep for 11 seconds 00000100:00100000:3.0:1782480682.856171:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388113408 00000100:00100000:3.0:1782480682.856178:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388113408 00000100:00100000:3.0:1782480682.856250:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782480682.856257:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000fec12630 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:5782:x1869066388113408:12345-0@lo:101: 00010000:00010000:3.0:1782480682.856269:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480682.856280:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c3fce0d8/0x4776e02a9acf4e79 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4e72 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480682.856297:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c3fce0d8/0x4776e02a9acf4e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4e72 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480682.856305:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c3fce0d8/0x4776e02a9acf4e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4e72 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480682.856323:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c3fce0d8, rc 0) 00000100:00100000:3.0:1782480682.856362:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000fec12630 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5782:x1869066388113408:12345-0@lo:101: Request processed in 105us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480682.856367:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782480682.856430:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113408:0@lo:101: 00010000:00010000:1.0:1782480682.856442:0:5782:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000f2d68526/0x4776e02a9acf4e72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.856449:0:5782:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000f2d68526/0x4776e02a9acf4e72 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480682.856490:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113536:0@lo:501: 00000100:00100000:1.0:1782480682.856512:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.856905:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eee0bbf3 going to sleep for 11 seconds 00000100:00100000:0.0:1782480682.857019:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388113536 00000100:00100000:0.0:1782480682.857024:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388113536 00000100:00100000:0.0:1782480682.857048:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782480682.857053:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ce75f83c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5782:x1869066388113536:12345-0@lo:501: 00000100:00100000:0.0:1782480682.857290:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ce75f83c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5782:x1869066388113536:12345-0@lo:501: Request processed in 236us (777us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480682.857297:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782480682.857493:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113536:0@lo:501: 00000100:00100000:1.0:1782480682.857525:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113664:0@lo:503: 00000100:00100000:1.0:1782480682.857570:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.857592:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 00000000eee0bbf3 going to sleep for 11 seconds 00000100:00100000:0.0:1782480682.857759:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388113664 00000100:00100000:0.0:1782480682.857764:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388113664 00000100:00100000:0.0:1782480682.857791:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782480682.857796:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000000a1c7d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5782:x1869066388113664:12345-0@lo:503: 00000100:00100000:0.0:1782480682.858088:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000000a1c7d36 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5782:x1869066388113664:12345-0@lo:503: Request processed in 292us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480682.858095:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782480682.858197:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388113664:0@lo:503: 00000100:00100000:1.0:1782480682.859051:0:5831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5831:1869066388113792:0@lo:502: 00000100:00100000:1.0:1782480682.859101:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.859166:0:5831:0:(client.c:2701:ptlrpc_set_wait()) set 000000008adae256 going to sleep for 11 seconds 00000100:00100000:0.0:1782480682.859201:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388113792 00000100:00100000:0.0:1782480682.859206:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388113792 00000100:00100000:0.0:1782480682.859258:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782480682.859264:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000042b2967c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5831:x1869066388113792:12345-0@lo:502: 00000100:00100000:0.0:1782480682.859584:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000042b2967c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5831:x1869066388113792:12345-0@lo:502: Request processed in 319us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480682.859590:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1782480682.859778:0:5831:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5831:1869066388113792:0@lo:502: 00000020:01000004:1.0:1782480682.859844:0:5831:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1782480682.859868:0:5831:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000cde121e0) 00000020:00000080:1.0:1782480682.859885:0:5831:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:1.0:1782480682.860095:0:5831:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000554e7526 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782480682.860099:0:5831:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000554e7526 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1782480682.860102:0:5831:0:(obd_mount.c:701:lustre_put_lsi()) put 00000000554e7526 4 00010000:00080000:1.0:1782480682.860131:0:5831:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000bcd7437a@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1782480682.864265:0:5831:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:1.0:1782480682.866569:0:5831:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1782480682.867758:0:5831:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782480682.867778:0:5831:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4776e02a9acf4e87 00000100:00080000:1.0:1782480682.867789:0:5831:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782480682.867795:0:5831:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bcd7437a using connection 192.168.201.158@tcp/0@lo 00000100:00100000:1.0:1782480682.867841:0:5831:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000345dbe16 x1869066388113920/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782480682.867888:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869066388113920:0@lo:38: 00000100:00100000:1.0:1782480682.867965:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.868040:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388113920 00000100:00100000:1.0:1782480682.868046:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388113920 00000100:00100000:1.0:1782480682.868086:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480682.868092:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c2ee613e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1869066388113920:12345-0@lo:38: 00000100:00100000:1.0:1782480682.868146:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c2ee613e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1869066388113920:12345-0@lo:38: Request processed in 53us (181us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782480682.868154:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480682.868195:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782480682.868201:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000bcd7437a lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782480682.868215:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782480682.868218:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869066388113920:0@lo:38: 00000100:00080000:1.0:1782480682.868246:0:5831:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1782480682.870542:0:5831:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5831:1869066388114048:0@lo:502: 00000100:00100000:1.0:1782480682.871038:0:5831:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480682.871092:0:5831:0:(client.c:2701:ptlrpc_set_wait()) set 000000008adae256 going to sleep for 11 seconds 00000100:00100000:2.0:1782480682.871136:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388114048 00000100:00100000:2.0:1782480682.871144:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388114048 00000100:00100000:2.0:1782480682.871192:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1782480682.871200:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000e7dfc2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5831:x1869066388114048:12345-0@lo:502: 00000100:00100000:2.0:1782480682.871998:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000e7dfc2f4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5831:x1869066388114048:12345-0@lo:502: Request processed in 796us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480682.872008:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782480682.872525:0:5831:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5831:1869066388114048:0@lo:502: 00000040:00080000:1.0:1782480682.872565:0:5831:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1782480682.876292:0:5782:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1782480682.876335:0:5782:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782480682.876356:0:5782:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000f2d68526/0x4776e02a9acf4e72 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480682.876370:0:5782:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000f2d68526/0x4776e02a9acf4e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782480682.876539:0:5782:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782480682.876541:0:5782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782480682.876543:0:5782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480682.876544:0:5782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480682.876545:0:5782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480682.876546:0:5782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480682.876548:0:5782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782480682.876549:0:5782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782480682.876550:0:5782:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480682.876552:0:5782:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480682.876553:0:5782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480682.876559:0:5782:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782480682.876563:0:5782:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1782480682.876566:0:5782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782480682.876567:0:5782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782480682.876568:0:5782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480682.876569:0:5782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480682.876570:0:5782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480682.876571:0:5782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480682.876571:0:5782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782480682.876572:0:5782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782480682.876573:0:5782:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480682.876574:0:5782:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480682.876575:0:5782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480682.876576:0:5782:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782480682.876626:0:5782:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1782480682.876645:0:5782:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b59859f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388114176:0@lo:253: 00000100:00100000:0.0:1782480682.876765:0:5782:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480682.876801:0:5782:0:(client.c:2701:ptlrpc_set_wait()) set 0000000071a4530d going to sleep for 11 seconds 00000100:00100000:0.0:1782480682.876876:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388114176 00000100:00100000:0.0:1782480682.876883:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388114176 00000100:00100000:0.0:1782480682.876926:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782480682.876934:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000002bbd9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5782:x1869066388114176:12345-0@lo:253: 20000000:01000000:0.0:1782480682.876959:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782480682.876975:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782480682.916366:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782480682.916386:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1782480682.916595:0:5818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782480682.916601:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782480682.916627:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480682.916645:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000007ad6be1b/0x4776e02a9acf4e5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4e56 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480682.916652:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480682.916727:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000007ad6be1b/0x4776e02a9acf4e5d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4e56 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480682.916742:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000007ad6be1b/0x4776e02a9acf4e5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4e56 expref: 12 pid: 5796 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480682.916755:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000bec3232c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1869066388114304:0@lo:104: 00000100:00100000:2.0:1782480682.916830:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480682.916884:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set 00000000441a20ae going to sleep for 11 seconds 00000100:00100000:1.0:1782480682.917142:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388114304 00000100:00100000:1.0:1782480682.917150:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388114304 00000100:00100000:1.0:1782480682.917198:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480682.917206:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000002f7ab5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:5818:x1869066388114304:12345-0@lo:104: 00010000:00010000:1.0:1782480682.917218:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917269:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782480682.917274:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000002f7ab5 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:5818:x1869066388114304:12345-0@lo:104: Request processed in 70us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480682.917290:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1782480682.917322:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480682.917326:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917333:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000714c566d already unused, calling callback (0000000013e54ffa) 10000000:00010000:1.0:1782480682.917336:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917343:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480682.917348:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480682.917353:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782480682.917379:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917385:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782480682.917584:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388114432:0@lo:103: 00000100:00100000:3.0:1782480682.917627:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782480682.917775:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917783:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: 00000000714c566d/0x4776e02a9acf4e56 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e5d expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917800:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480682.917802:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480682.917803:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480682.917835:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388114432 00000100:00100000:1.0:1782480682.917846:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388114432 00010000:00010000:1.0:1782480682.917863:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000007ad6be1b/0x4776e02a9acf4e5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4e56 expref: 13 pid: 5796 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480682.917884:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480682.917891:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000aa6f980f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:3311:x1869066388114432:12345-0@lo:103: 00010000:00010000:1.0:1782480682.917901:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480682.917904:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000007ad6be1b/0x4776e02a9acf4e5d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4e56 expref: 13 pid: 5796 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917913:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000007ad6be1b/0x4776e02a9acf4e5d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4e56 expref: 13 pid: 5796 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917929:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917936:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782480682.917949:0:5786:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001349198s 00010000:00010000:1.0:1782480682.917952:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917958:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917963:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917968:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917983:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000035c3a44d already unused, calling callback (00000000a5b936b3) 00010000:00010000:1.0:1782480682.917987:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.917994:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.918001:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.918010:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480682.918042:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000aa6f980f pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:3311:x1869066388114432:12345-0@lo:103: Request processed in 152us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480682.918048:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480682.918080:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388114432:0@lo:103: 00010000:00010000:1.0:1782480682.918103:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000007ad6be1b/0x4776e02a9acf4e5d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4e56 expref: 12 pid: 5796 timeout: 363 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480682.918113:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000bec3232c pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1869066388114304:0@lo:104: 00010000:00010000:1.0:1782480682.918123:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.918129:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.918134:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480682.918138:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000035c3a44d/0x4776e02a9acf4e8e lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480682.928626:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000002bbd9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:5782:x1869066388114176:12345-0@lo:253: Request processed in 51686us (51854us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480682.928641:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782480682.929056:0:5782:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b59859f0 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5782:1869066388114176:0@lo:253: 10000000:01000000:0.0:1782480682.929072:0:5782:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1782480682.929076:0:5782:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782480682.929077:0:5782:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1782480682.929078:0:5782:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480682.929079:0:5782:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480682.929080:0:5782:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480682.929081:0:5782:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480682.929082:0:5782:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1782480682.929084:0:5782:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1782480682.929085:0:5782:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480682.929099:0:5782:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480682.929100:0:5782:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480682.929102:0:5782:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782480682.929120:0:5782:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1782480682.935065:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1782480682.935798:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1782480682.936034:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1782480682.936209:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1782480682.936580:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:1.0:1782480682.937010:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:1.0:1782480682.937927:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:1.0:1782480682.938091:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:1.0:1782480682.938271:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:1.0:1782480682.938592:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:1.0:1782480682.939047:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:1.0:1782480682.939229:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1782480682.985247:0:5782:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:3.0:1782480683.012035:0:5782:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1782480683.012327:0:5837:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1782480683.015503:0:5836:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1782480683.015511:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:0.0:1782480683.015638:0:5782:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1782480683.015849:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1782480683.016293:0:5782:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1782480683.016301:0:5782:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1782480683.016751:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782480683.017952:0:5782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782480683.018840:0:5782:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1782480683.018882:0:5782:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1782480683.019139:0:5782:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1782480683.019298:0:5782:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:1.0:1782480683.021785:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:1.0:1782480683.021950:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:1.0:1782480683.022101:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:1.0:1782480683.022264:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:1.0:1782480683.022383:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:1.0:1782480683.022516:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:1.0:1782480683.022641:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:1.0:1782480683.022828:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:1.0:1782480683.022952:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:1.0:1782480683.023096:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:1.0:1782480683.023216:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:1.0:1782480683.023350:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:1.0:1782480683.023485:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:1.0:1782480683.023628:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:1.0:1782480683.023803:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:1.0:1782480683.030973:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:1.0:1782480683.031323:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:1.0:1782480683.031532:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:1.0:1782480683.032189:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:1.0:1782480683.032349:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1782480683.032548:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1782480683.032886:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1782480683.033016:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1782480683.033154:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1782480683.033268:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1782480683.033850:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1782480683.034008:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1782480683.034161:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1782480683.034295:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1782480683.034970:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1782480683.035162:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1782480683.035304:0:5782:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1782480683.035536:0:5782:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:1.0:1782480683.072375:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:0.0:1782480683.122829:0:5782:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1782480683.122872:0:5782:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb057418d3988 00100000:10000000:0.0:1782480683.122883:0:5782:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:1.0:1782480683.124718:0:5837:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1782480683.124796:0:5837:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1782480683.124801:0:5837:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:0.0:1782480683.125532:0:5782:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782480683.125547:0:5782:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782480683.125567:0:5782:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1782480683.125593:0:5782:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1782480683.870917:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480684.895298:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480685.932845:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480686.942886:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782480687.586638:0:6079:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1782480687.966937:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782480688.039353:0:8:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1782480688.039364:0:8:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1782480688.039367:0:8:0:(import.c:65:import_set_state_nolock()) 00000000bcd7437a lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1782480688.039381:0:8:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 00000000bcd7437a using connection 192.168.201.158@tcp/0@lo 00000100:00100000:3.0:1782480688.039402:0:8:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000006f430fe1 x1869066388114688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782480688.039509:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480688.039522:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005e85cc1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388114560:0@lo:400: 00000100:00100000:3.0:1782480688.041527:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480688.042887:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000006f430fe1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869066388114688:0@lo:38: 00000100:00100000:3.0:1782480688.042990:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480688.045558:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388114560 00000100:00100000:1.0:1782480688.045574:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388114560 00000100:00100000:1.0:1782480688.045640:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782480688.045649:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000009853455d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:3313:x1869066388114560:12345-0@lo:400: 00000100:00100000:1.0:1782480688.045772:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000009853455d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:3313:x1869066388114560:12345-0@lo:400: Request processed in 125us (4251us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480688.045780:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1782480688.045821:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388114688 00000100:00100000:1.0:1782480688.045825:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388114688 00000100:00100000:1.0:1782480688.045847:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480688.045852:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000bf8aa7c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1869066388114688:12345-0@lo:38: 00010000:00080000:1.0:1782480688.045873:0:5804:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 218 last 0 00000020:00000080:1.0:1782480688.045935:0:5804:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4776e02a9acf4e95 00000004:00100000:1.0:1782480688.045996:0:5804:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782480688.046241:0:5804:0:(import.c:65:import_set_state_nolock()) 0000000073cdf922 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782480688.046305:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000bf8aa7c6 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869066388114688:12345-0@lo:38: Request processed in 452us (3315us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480688.046312:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782480688.046590:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000006f430fe1 x1869066388114688/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782480698 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782480688.046609:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782480688.046616:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1782480688.046621:0:3309:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1782480688.046623:0:3309:0:(import.c:65:import_set_state_nolock()) 00000000bcd7437a lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1782480688.046628:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000006f430fe1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869066388114688:0@lo:38: 00000100:00100000:3.0:1782480688.046687:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005e85cc1d pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388114560:0@lo:400: 00010000:00010000:2.0:1782480688.990864:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782480689.570772:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782480689.570782:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91d7c52cd800 from 3 10000000:01000000:1.0:1782480689.570788:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782480689.570855:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000674b3981/0x4776e02a9acf4e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480689.570868:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000674b3981/0x4776e02a9acf4e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480689.570879:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000674b3981/0x4776e02a9acf4e9c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480689.570924:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388114816:0@lo:101: 00000100:00100000:1.0:1782480689.571023:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480689.571158:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set 0000000028c54196 going to sleep for 11 seconds 00000100:00100000:2.0:1782480689.572308:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388114816 00000100:00100000:2.0:1782480689.572319:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388114816 00000100:00100000:3.0:1782480689.575372:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782480689.575386:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000874ff4c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:5799:x1869066388114816:12345-0@lo:101: 00010000:00010000:3.0:1782480689.575405:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480689.575423:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000008c444042/0x4776e02a9acf4ea3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4e9c expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480689.575450:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008c444042/0x4776e02a9acf4ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4e9c expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480689.575461:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000008c444042/0x4776e02a9acf4ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4e9c expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480689.575487:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000008c444042, rc 0) 00000100:00100000:3.0:1782480689.575764:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000874ff4c9 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5799:x1869066388114816:12345-0@lo:101: Request processed in 381us (4741us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480689.575773:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782480689.581453:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000345dbe16 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388114816:0@lo:101: 00010000:00010000:2.0:1782480689.581486:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000674b3981/0x4776e02a9acf4e9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480689.581498:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000674b3981/0x4776e02a9acf4e9c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480689.581582:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000f8d2fc68 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388114944:0@lo:256: 00000100:00100000:2.0:1782480689.581799:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480689.581932:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set 00000000117d64f7 going to sleep for 11 seconds 00000100:00100000:1.0:1782480689.582030:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388114944 00000100:00100000:1.0:1782480689.582038:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388114944 00000100:00100000:1.0:1782480689.582091:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1782480689.582099:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000010eeae8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5799:x1869066388114944:12345-0@lo:256: 20000000:01000000:1.0:1782480689.582119:0:5794:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1782480689.582136:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1782480689.582140:0:5794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1782480689.582235:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000010eeae8e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5799:x1869066388114944:12345-0@lo:256: Request processed in 136us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480689.582243:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782480689.582590:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000f8d2fc68 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388114944:0@lo:256: 10000000:01000000:3.0:1782480689.582645:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782480689.582653:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: 00000000674b3981/0x4776e02a9acf4e9c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480689.582694:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: 00000000674b3981/0x4776e02a9acf4e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480690.015104:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480691.043631:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480692.064373:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782480692.177621:0:6281:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffedf6ad940 20000000:00000080:3.0:1782480692.177645:0:6281:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d7eca31000 uarg=0000000000000000 20000000:01000000:3.0:1782480692.177719:0:6281:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:3.0:1782480692.177728:0:6281:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:3.0:1782480692.177733:0:6281:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:3.0:1782480692.177944:0:6281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:3.0:1782480692.177955:0:6281:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:3.0:1782480692.185086:0:6281:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480692.185343:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1782480692.185406:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:3.0:1782480692.185462:0:6281:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:3.0:1782480692.185481:0:6281:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1782480692.185498:0:6281:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480692.187724:0:6281:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000086beafca/0x4776e02a9acf4e6b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4e64 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480692.187733:0:6281:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480692.187777:0:6281:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000086beafca/0x4776e02a9acf4e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4e64 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480692.187792:0:6281:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000086beafca/0x4776e02a9acf4e6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4e64 expref: 11 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480692.187807:0:6281:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000005e85cc1d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6281:1869066388115072:0@lo:104: 00000100:00100000:3.0:1782480692.187877:0:6281:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480692.187929:0:6281:0:(client.c:2701:ptlrpc_set_wait()) set 0000000014d05a76 going to sleep for 11 seconds 00000100:00100000:0.0:1782480692.188028:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388115072 00000100:00100000:0.0:1782480692.188036:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388115072 00000100:00100000:0.0:1782480692.188081:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480692.188089:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000006f430fe1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:6281:x1869066388115072:12345-0@lo:104: 00010000:00010000:0.0:1782480692.188108:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188168:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782480692.188174:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000006f430fe1 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:6281:x1869066388115072:12345-0@lo:104: Request processed in 86us (298us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480692.188181:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1782480692.188199:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480692.188204:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188211:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000c568ab90 already unused, calling callback (0000000013e54ffa) 10000000:00010000:0.0:1782480692.188214:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188221:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480692.188226:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480692.188231:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782480692.188264:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188271:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480692.188292:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188298:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: 00000000c568ab90/0x4776e02a9acf4e64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e6b expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480692.188307:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480692.188318:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@00000000b59859f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388115200:0@lo:103: 00010000:00010000:0.0:1782480692.188322:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480692.188324:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480692.188325:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480692.188346:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480692.188431:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388115200 00000100:00100000:0.0:1782480692.188435:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388115200 00000100:00100000:3.0:1782480692.188443:0:6281:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000005e85cc1d pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6281:1869066388115072:0@lo:104: 00010000:00010000:0.0:1782480692.188449:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000086beafca/0x4776e02a9acf4e6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4e64 expref: 12 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480692.188463:0:6281:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480692.188476:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480692.188482:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@0000000071d90a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:3312:x1869066388115200:12345-0@lo:103: 00010000:00010000:0.0:1782480692.188492:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480692.188496:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000086beafca/0x4776e02a9acf4e6b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4e64 expref: 12 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188504:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000086beafca/0x4776e02a9acf4e6b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4e64 expref: 12 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188516:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000086beafca/0x4776e02a9acf4e6b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4e64 expref: 12 pid: 5797 timeout: 372 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188528:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188534:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188544:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188561:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188572:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188578:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188583:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000008f2f11e5 already unused, calling callback (00000000a5b936b3) 00010000:00010000:0.0:1782480692.188586:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188591:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188608:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480692.188616:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480692.188641:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@0000000071d90a99 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:3312:x1869066388115200:12345-0@lo:103: Request processed in 160us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480692.188647:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782480692.188841:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@00000000b59859f0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388115200:0@lo:103: 00010000:00010000:3.0:1782480692.188932:0:6281:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480692.188940:0:6281:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480692.188946:0:6281:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000008f2f11e5/0x4776e02a9acf4eaa lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6281 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480693.091914:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480693.151801:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000043a11af7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388115328:0@lo:400: 00000100:00100000:0.0:1782480693.151881:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@0000000031a99f8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388115456:0@lo:400: 00000100:00100000:0.0:1782480693.151952:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480693.152021:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388115456 00000100:00100000:0.0:1782480693.152029:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388115456 00000100:00100000:3.0:1782480693.152188:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480693.152217:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388115328 00000100:00100000:3.0:1782480693.152220:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388115328 00000100:00100000:3.0:1782480693.152255:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782480693.152262:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000df6ad65a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:3310:x1869066388115328:12345-0@lo:400: 00000100:00100000:3.0:1782480693.152305:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000df6ad65a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:3310:x1869066388115328:12345-0@lo:400: Request processed in 44us (118us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480693.152312:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782480693.152357:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000043a11af7 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388115328:0@lo:400: 00000100:00100000:0.0:1782480693.152564:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480693.152570:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000009dc695ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388115456:12345-0@lo:400: 00000100:00100000:0.0:1782480693.152605:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000009dc695ed pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388115456:12345-0@lo:400: Request processed in 36us (655us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480693.152617:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782480693.152654:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000031a99f8f x1869066388115456/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480709 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480693.152687:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@0000000031a99f8f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388115456:0@lo:400: 00010000:00010000:3.0:1782480694.122010:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480695.170315:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480696.248178:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782480696.734722:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480696.734730:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c52cd800 from 1 10000000:01000000:2.0:1782480696.734734:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480696.734783:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: 00000000b40b4d86/0x4776e02a9acf4eb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480696.734796:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: 00000000b40b4d86/0x4776e02a9acf4eb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480696.734818:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: 00000000b40b4d86/0x4776e02a9acf4eb1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480696.734842:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003673a778 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388115584:0@lo:101: 00000100:00100000:2.0:1782480696.734911:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480696.734967:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set 0000000012557b9a going to sleep for 11 seconds 00000100:00100000:2.0:1782480696.734988:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388115584 00000100:00100000:2.0:1782480696.734994:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388115584 00000100:00100000:2.0:1782480696.735040:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480696.735048:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000ceed48bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:5799:x1869066388115584:12345-0@lo:101: 00010000:00010000:2.0:1782480696.735061:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480696.735072:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ede1e95e/0x4776e02a9acf4eb8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4eb1 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480696.735094:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ede1e95e/0x4776e02a9acf4eb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4eb1 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480696.735103:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ede1e95e/0x4776e02a9acf4eb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4eb1 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480696.735111:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ede1e95e, rc 0) 00000100:00100000:2.0:1782480696.735145:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000ceed48bc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5799:x1869066388115584:12345-0@lo:101: Request processed in 99us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480696.735151:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480696.735189:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003673a778 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388115584:0@lo:101: 00010000:00010000:2.0:1782480696.735200:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: 00000000b40b4d86/0x4776e02a9acf4eb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480696.735218:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: 00000000b40b4d86/0x4776e02a9acf4eb1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480696.735265:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003673a778 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388115712:0@lo:501: 00000100:00100000:2.0:1782480696.735286:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480696.735299:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set 0000000012557b9a going to sleep for 11 seconds 00000100:00100000:2.0:1782480696.735309:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388115712 00000100:00100000:2.0:1782480696.735312:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388115712 00000100:00100000:2.0:1782480696.735329:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480696.735333:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@000000003bb5bbbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5799:x1869066388115712:12345-0@lo:501: 00000100:00100000:2.0:1782480696.735566:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@000000003bb5bbbd pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5799:x1869066388115712:12345-0@lo:501: Request processed in 232us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480696.735573:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480696.735614:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003673a778 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388115712:0@lo:501: 00000100:00100000:2.0:1782480696.735635:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003673a778 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388115840:0@lo:503: 00000100:00100000:2.0:1782480696.735693:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480696.735711:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set 0000000012557b9a going to sleep for 11 seconds 00000100:00100000:2.0:1782480696.735720:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388115840 00000100:00100000:2.0:1782480696.735722:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388115840 00000100:00100000:2.0:1782480696.735738:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782480696.735743:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000716395b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5799:x1869066388115840:12345-0@lo:503: 00000100:00100000:2.0:1782480696.735878:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000716395b2 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5799:x1869066388115840:12345-0@lo:503: Request processed in 135us (184us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480696.735884:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782480696.735915:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003673a778 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388115840:0@lo:503: 00000100:00100000:2.0:1782480696.738801:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@000000003673a778 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6554:1869066388115968:0@lo:502: 00000100:00100000:2.0:1782480696.738887:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480696.738928:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388115968 00000100:00100000:2.0:1782480696.738935:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388115968 00000100:00100000:2.0:1782480696.738974:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782480696.738982:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@00000000c95a7e65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6554:x1869066388115968:12345-0@lo:502: 00000100:00100000:2.0:1782480696.739198:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@00000000c95a7e65 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6554:x1869066388115968:12345-0@lo:502: Request processed in 216us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480696.739206:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782480696.739268:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set 00000000a0672db4 going to sleep for 11 seconds 00000100:00100000:2.0:1782480696.739288:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@000000003673a778 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6554:1869066388115968:0@lo:502: 00000020:01000000:2.0:1782480696.739314:0:6554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480696.739323:0:6554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480696.739326:0:6554:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782480696.739334:0:6554:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d7c52cd800 00000020:00000080:2.0:1782480696.739336:0:6554:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782480696.739373:0:6554:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4dddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6554:1869066388116096:0@lo:502: 00000100:00100000:2.0:1782480696.739403:0:6554:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480696.739427:0:6554:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c5018c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480696.740114:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388116096 00000100:00100000:3.0:1782480696.740122:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388116096 00000100:00100000:3.0:1782480696.740164:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782480696.740173:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6554:x1869066388116096:12345-0@lo:502: 00000100:00100000:3.0:1782480696.740354:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6554:x1869066388116096:12345-0@lo:502: Request processed in 181us (949us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480696.740361:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782480696.743693:0:6554:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4dddf80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6554:1869066388116096:0@lo:502: 00000020:01000000:2.0:1782480696.743738:0:6554:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480696.743746:0:6554:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480696.743749:0:6554:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782480696.743754:0:6554:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1782480696.746645:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1782480696.746694:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782480696.746708:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3e00/0x4776e02a9acf4eb1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480696.746722:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3e00/0x4776e02a9acf4eb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480697.248967:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782480698.085969:0:6604:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782480698.085975:0:6604:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1782480698.086301:0:6604:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91d7c7ca2800 00000020:01000004:2.0:1782480698.086319:0:6604:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:2.0:1782480698.086336:0:6604:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782480698.086350:0:6604:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91d7c2d00000) 00000020:00000080:2.0:1782480698.086365:0:6604:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782480698.103789:0:6604:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1782480698.104216:0:6604:0:(scrub.c:229:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1782480698.133356:0:6604:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1782480698.148159:0:6604:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782480698.148202:0:6604:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1782480698.148269:0:6604:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782480698.148295:0:6604:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1782480698.148990:0:6604:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782480698.149001:0:6604:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782480698.149089:0:6604:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4776e02a9acf4ec6 00000020:01000004:3.0:1782480698.149172:0:6604:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1782480698.149196:0:6604:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782480698.149200:0:6604:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782480698.149207:0:6604:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782480698.149211:0:6604:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782480698.149232:0:6604:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91d7ed2199c0) 00000020:00000080:3.0:1782480698.149245:0:6604:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1782480698.152014:0:6604:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782480698.152186:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782480698.152192:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1782480698.160906:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1782480698.161077:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1782480698.161534:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1782480698.161540:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1782480698.167266:0:6604:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480698.167634:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1782480698.167640:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1782480698.168537:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1782480698.168544:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:1.0:1782480698.196944:0:6604:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480698.197275:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782480698.197283:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:1.0:1782480698.199209:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1782480698.199224:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:1.0:1782480698.200854:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1782480698.200867:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:1.0:1782480698.204310:0:6604:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480698.204651:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:1.0:1782480698.204760:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:1.0:1782480698.205617:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:1.0:1782480698.205625:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00010000:00010000:0.0:1782480698.270891:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480698.279702:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388116224:0@lo:400: 00000100:00100000:3.0:1782480698.279799:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480698.280353:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388116224 00000100:00100000:0.0:1782480698.280364:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388116224 00000100:00100000:0.0:1782480698.280431:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782480698.280441:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:3312:x1869066388116224:12345-0@lo:400: 00000100:00100000:0.0:1782480698.285271:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:3312:x1869066388116224:12345-0@lo:400: Request processed in 4819us (5460us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480698.285301:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1782480698.285692:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388116352:0@lo:400: 00000100:00100000:1.0:1782480698.285757:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480698.286969:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388116352 00000100:00100000:0.0:1782480698.286984:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388116352 00000100:00100000:0.0:1782480698.287055:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480698.287066:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388116352:12345-0@lo:400: 00000100:00100000:0.0:1782480698.287153:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388116352:12345-0@lo:400: Request processed in 89us (1395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480698.287160:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782480698.287209:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d7c67b5500 x1869066388116352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480698.287224:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388116352:0@lo:400: 00000100:00100000:3.0:1782480698.288956:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388116224:0@lo:400: 00000100:00100000:2.0:1782480698.292845:0:6604:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480698.293069:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1782480698.293076:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1782480698.294820:0:6604:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1782480698.294832:0:6604:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1782480698.295244:0:6604:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1782480698.295268:0:6604:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1782480698.295275:0:6604:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1782480698.341082:0:6604:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782480698.341124:0:6604:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1782480698.341128:0:6604:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782480698.341130:0:6604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782480698.341131:0:6604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480698.341132:0:6604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480698.341133:0:6604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480698.341135:0:6604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480698.341136:0:6604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480698.341137:0:6604:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480698.341139:0:6604:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480698.341140:0:6604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480698.341141:0:6604:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782480698.341145:0:6604:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1782480698.341146:0:6604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782480698.341148:0:6604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782480698.341149:0:6604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480698.341150:0:6604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480698.341156:0:6604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480698.341157:0:6604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480698.341158:0:6604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480698.341159:0:6604:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480698.341160:0:6604:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480698.341161:0:6604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480698.341162:0:6604:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782480698.341196:0:6604:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782480698.341217:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388116480:0@lo:253: 00000100:00100000:0.0:1782480698.341567:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480698.341629:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c39360c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480698.342141:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388116480 00000100:00100000:3.0:1782480698.342150:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388116480 00000100:00100000:3.0:1782480698.342210:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782480698.342220:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388116480:12345-0@lo:253: 20000000:01000000:3.0:1782480698.342268:0:5794:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1782480698.342273:0:5794:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:3.0:1782480698.342279:0:5794:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:3.0:1782480698.342282:0:5794:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:3.0:1782480698.344299:0:5794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480698.345229:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:3.0:1782480698.345249:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:3.0:1782480698.345312:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:3.0:1782480698.345321:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:3.0:1782480698.345353:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:3.0:1782480698.345419:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:3.0:1782480698.345982:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:3.0:1782480698.346006:0:5794:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:3.0:1782480698.346015:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:3.0:1782480698.346056:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:3.0:1782480698.346066:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782480698.346129:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:3.0:1782480698.346138:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:3.0:1782480698.346172:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:3.0:1782480698.346182:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782480698.346212:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:3.0:1782480698.346264:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:3.0:1782480698.347322:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:3.0:1782480698.347345:0:5794:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:3.0:1782480698.347347:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:3.0:1782480698.347381:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:3.0:1782480698.347389:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782480698.347626:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:3.0:1782480698.347635:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:3.0:1782480698.347897:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:3.0:1782480698.347908:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:3.0:1782480698.347944:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:3.0:1782480698.347982:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:3.0:1782480698.348000:0:5794:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782480698.348004:0:5794:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782480698.348008:0:5794:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782480698.348022:0:5794:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782480698.348025:0:5794:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782480698.348061:0:5794:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782480698.348064:0:5794:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:2.0:1782480698.352248:0:6619:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 13 marker 9 1->4: lustre sys.timeout 20000000:01000000:2.0:1782480698.352407:0:6619:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 15 marker 9 2->4: lustre sys.timeout 00000040:00080000:2.0:1782480698.352543:0:6619:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:3.0:1782480698.353130:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:3.0:1782480698.353174:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:3.0:1782480698.353237:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:3.0:1782480698.353251:0:5794:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782480698.353253:0:5794:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1782480698.358452:0:6620:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:3.0:1782480698.358877:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:3.0:1782480698.358920:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:3.0:1782480698.358997:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:3.0:1782480698.359011:0:5794:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782480698.359014:0:5794:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782480698.366140:0:6621:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 18 marker 10 1->4: lustre sys.timeout 20000000:01000000:0.0:1782480698.366238:0:6621:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 20 marker 10 2->4: lustre sys.timeout 00000040:00080000:0.0:1782480698.366334:0:6621:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1782480698.367060:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1782480698.367109:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1782480698.367147:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1782480698.367168:0:5794:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1782480698.367171:0:5794:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1782480698.367181:0:5794:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1782480698.367200:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.367220:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4ded lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4de6 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.367228:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c13a2400/0x4776e02a9acf4e09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4e02 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.367235:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802059000/0x4776e02a9acf4e79 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4e72 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.367263:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.367589:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802059000/0x4776e02a9acf4e79 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4e72 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.367613:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d802059000/0x4776e02a9acf4e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4e72 expref: 12 pid: 5794 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.367628:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4dddf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388116608:0@lo:104: 00000100:00100000:2.0:1782480698.367757:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782480698.367818:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c13a2400/0x4776e02a9acf4e09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4e02 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.367827:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c13a2400/0x4776e02a9acf4e09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4e02 expref: 12 pid: 5797 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.367835:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388116736:0@lo:104: 00000100:00100000:2.0:1782480698.367856:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782480698.367881:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4ded lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4de6 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.367890:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4ded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4de6 expref: 12 pid: 5796 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.367898:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388116864:0@lo:104: 00000100:00100000:2.0:1782480698.367916:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.367925:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c52f29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480698.367997:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388116608 00000100:00100000:1.0:1782480698.368005:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388116608 00000100:00100000:1.0:1782480698.368042:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388116736 00000100:00100000:1.0:1782480698.368045:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388116736 00000100:00100000:1.0:1782480698.368054:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388116864 00000100:00100000:1.0:1782480698.368057:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388116864 00000100:00100000:1.0:1782480698.368070:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480698.368079:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:5794:x1869066388116608:12345-0@lo:104: 00010000:00010000:1.0:1782480698.368091:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c167be00/0x4776e02a9acf4e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368153:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782480698.368160:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:5794:x1869066388116608:12345-0@lo:104: Request processed in 81us (403us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.368167:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480698.368182:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480698.368188:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:5794:x1869066388116736:12345-0@lo:104: 00010000:00010000:1.0:1782480698.368197:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c0030400/0x4776e02a9acf4e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368229:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782480698.368235:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:5794:x1869066388116736:12345-0@lo:104: Request processed in 47us (378us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.368240:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480698.368251:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782480698.368257:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:5794:x1869066388116864:12345-0@lo:104: 00010000:00010000:1.0:1782480698.368263:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368321:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1782480698.368326:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:5794:x1869066388116864:12345-0@lo:104: Request processed in 70us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.368332:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:1.0:1782480698.368350:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782480698.368356:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c167be00/0x4776e02a9acf4e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368364:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167be00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:1.0:1782480698.368368:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167be00/0x4776e02a9acf4e72 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368378:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167be00/0x4776e02a9acf4e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480698.368385:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167be00/0x4776e02a9acf4e72 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480698.368391:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782480698.368434:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c167be00/0x4776e02a9acf4e72 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368441:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782480698.368477:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c167be00/0x4776e02a9acf4e72 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368484:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167be00/0x4776e02a9acf4e72 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e79 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368508:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782480698.368512:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c0030400/0x4776e02a9acf4e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368518:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0030400 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:1.0:1782480698.368520:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c0030400/0x4776e02a9acf4e02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368526:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c0030400/0x4776e02a9acf4e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480698.368543:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c0030400/0x4776e02a9acf4e02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480698.368548:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782480698.368571:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c0030400/0x4776e02a9acf4e02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368577:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782480698.368583:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c0030400/0x4776e02a9acf4e02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368590:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c0030400/0x4776e02a9acf4e02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4e09 expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368600:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480698.368603:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368618:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b600 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:1.0:1782480698.368622:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4de6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368629:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480698.368636:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4de6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480698.368641:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782480698.368655:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4de6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368684:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782480698.368700:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4de6 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368707:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4de6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4ded expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.368721:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480698.368723:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480698.368725:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480698.368732:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480698.368752:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388117120:0@lo:103: 00000100:00100000:1.0:1782480698.368782:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480698.368806:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480698.368812:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388116992:0@lo:103: 00000100:00100000:1.0:1782480698.368841:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480698.368861:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782480698.368870:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388117248:0@lo:103: 00000100:00100000:1.0:1782480698.368892:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480698.368918:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388117120 00000100:00100000:1.0:1782480698.368923:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388117120 00010000:00010000:1.0:1782480698.368942:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c13a2400/0x4776e02a9acf4e09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4e02 expref: 13 pid: 5797 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480698.368957:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388116992 00000100:00100000:1.0:1782480698.368960:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388116992 00010000:00010000:1.0:1782480698.368970:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802059000/0x4776e02a9acf4e79 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4e72 expref: 14 pid: 5794 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480698.368981:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388117248 00000100:00100000:1.0:1782480698.368983:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388117248 00010000:00010000:1.0:1782480698.368992:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4ded lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4de6 expref: 15 pid: 5796 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480698.369003:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480698.369009:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:3311:x1869066388117120:12345-0@lo:103: 00010000:00010000:1.0:1782480698.369020:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480698.369025:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c13a2400/0x4776e02a9acf4e09 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4e02 expref: 15 pid: 5797 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369034:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c13a2400/0x4776e02a9acf4e09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4e02 expref: 15 pid: 5797 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369048:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480698.369077:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:3311:x1869066388117120:12345-0@lo:103: Request processed in 68us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.369089:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480698.369103:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480698.369110:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:3311:x1869066388116992:12345-0@lo:103: 00010000:00010000:1.0:1782480698.369118:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480698.369123:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802059000/0x4776e02a9acf4e79 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4e72 expref: 14 pid: 5794 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369133:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802059000/0x4776e02a9acf4e79 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4e72 expref: 14 pid: 5794 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369142:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480698.369164:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:3311:x1869066388116992:12345-0@lo:103: Request processed in 56us (322us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.369170:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782480698.369181:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782480698.369187:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:3313:x1869066388117248:12345-0@lo:103: 00010000:00010000:1.0:1782480698.369194:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480698.369198:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4ded lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4de6 expref: 13 pid: 5796 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369207:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4ded lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4de6 expref: 13 pid: 5796 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369220:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369227:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369253:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369260:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369267:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369273:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369278:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c13a2200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782480698.369282:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369289:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369297:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.369306:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480698.369334:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:3313:x1869066388117248:12345-0@lo:103: Request processed in 147us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.369340:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782480698.369374:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388117248:0@lo:103: 00000100:00100000:1.0:1782480698.369396:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388116992:0@lo:103: 00000100:00100000:1.0:1782480698.369403:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388117120:0@lo:103: 00010000:00010000:2.0:1782480698.370287:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802059000/0x4776e02a9acf4e79 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4e72 expref: 12 pid: 5794 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.370451:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4dddf80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388116608:0@lo:104: 00010000:00010000:2.0:1782480698.370528:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a2400/0x4776e02a9acf4e09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4e02 expref: 11 pid: 5797 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.370540:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388116736:0@lo:104: 00010000:00010000:2.0:1782480698.370561:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4ded lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4de6 expref: 10 pid: 5796 timeout: 378 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.370573:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388116864:0@lo:104: 00010000:00010000:2.0:1782480698.370594:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.370603:0:5794:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.370610:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.370615:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a2200/0x4776e02a9acf4ed4 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782480698.370632:0:5794:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1782480698.464303:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+9:6604:x1869066388116480:12345-0@lo:253: Request processed in 122072us (122724us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.464322:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480698.464446:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388116480:0@lo:253: 10000000:01000000:0.0:1782480698.464475:0:6604:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782480698.464479:0:6604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782480698.464481:0:6604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782480698.464482:0:6604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480698.464484:0:6604:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1782480698.464485:0:6604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480698.464487:0:6604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480698.464488:0:6604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480698.464490:0:6604:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782480698.464492:0:6604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480698.464493:0:6604:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782480698.464517:0:6604:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d7c7ca2800 from lustre-OST0000 10000000:01000000:0.0:1782480698.464546:0:6604:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1782480698.464560:0:6604:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1782480698.464568:0:6604:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91d7c2d04d40 local copy 10000000:01000000:0.0:1782480698.464572:0:6604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782480698.464611:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.464622:0:6604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.464646:0:6604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480698.464686:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388117376:0@lo:101: 00000100:00100000:0.0:1782480698.464724:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480698.464785:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c39369c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480698.465033:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388117376 00000100:00100000:1.0:1782480698.465040:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388117376 00000100:00100000:1.0:1782480698.465094:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782480698.465105:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+9:6604:x1869066388117376:12345-0@lo:101: 00010000:00010000:1.0:1782480698.465122:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480698.465139:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c167b600/0x4776e02a9acf4ee2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4edb expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.465168:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167b600/0x4776e02a9acf4ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4edb expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.465179:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c167b600/0x4776e02a9acf4ee2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4edb expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.465189:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c167b600, rc 0) 00000100:00100000:1.0:1782480698.465241:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+10:6604:x1869066388117376:12345-0@lo:101: Request processed in 137us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.465248:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782480698.465849:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388117376:0@lo:101: 00010000:00010000:2.0:1782480698.465866:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.465876:0:6604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.466003:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388117504:0@lo:501: 00000100:00100000:2.0:1782480698.466042:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.466085:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c52f29c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480698.467323:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388117504 00000100:00100000:1.0:1782480698.467334:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388117504 00000100:00100000:1.0:1782480698.467399:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1782480698.467409:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+10:6604:x1869066388117504:12345-0@lo:501: 00000100:00100000:1.0:1782480698.467738:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+10:6604:x1869066388117504:12345-0@lo:501: Request processed in 329us (1693us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782480698.467754:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782480698.470101:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388117504:0@lo:501: 10000000:01000000:2.0:1782480698.470133:0:6604:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782480698.470187:0:6604:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782480698.470196:0:6604:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.470207:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.470213:0:6604:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.470235:0:6604:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1782480698.470259:0:6604:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d7c7ca2800 10000000:01000000:2.0:1782480698.470265:0:6604:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782480698.470270:0:6604:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91d7c2d04d40 10000000:01000000:2.0:1782480698.470273:0:6604:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1782480698.470276:0:6604:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91d7c2d04d40 from 1 10000000:01000000:2.0:1782480698.470279:0:6604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782480698.470322:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2200/0x4776e02a9acf4ee9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.470331:0:6604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2200/0x4776e02a9acf4ee9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.470359:0:6604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2200/0x4776e02a9acf4ee9 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.470381:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388117632:0@lo:101: 00000100:00100000:2.0:1782480698.470441:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.470488:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c52f2c00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480698.470545:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388117632 00000100:00100000:0.0:1782480698.470560:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388117632 00000100:00100000:0.0:1782480698.470620:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782480698.470630:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+10:6604:x1869066388117632:12345-0@lo:101: 00010000:00010000:0.0:1782480698.470643:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480698.470656:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c0030600/0x4776e02a9acf4ef0 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4ee9 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.470721:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c0030600/0x4776e02a9acf4ef0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4ee9 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.470732:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c0030600/0x4776e02a9acf4ef0 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4ee9 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.470750:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0030600, rc 0) 00010000:00010000:1.0:1782480698.470765:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480698.470773:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.470782:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0031a00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:1.0:1782480698.470786:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480698.470789:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388117632:12345-0@lo:101: Request processed in 162us (349us total) trans 0 rc 0/0 00010000:00010000:1.0:1782480698.470796:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480698.470796:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 10000000:00010000:1.0:1782480698.470802:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480698.470809:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1782480698.470829:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.470836:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782480698.470863:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.470870:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c0031a00/0x4776e02a9acf4edb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x4776e02a9acf4ee2 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.470888:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480698.470890:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480698.470891:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480698.470898:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480698.470904:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388117632:0@lo:101: 00000100:00100000:1.0:1782480698.470907:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388117760:0@lo:103: 00010000:00010000:3.0:1782480698.470916:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2200/0x4776e02a9acf4ee9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ef0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480698.470925:0:6604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2200/0x4776e02a9acf4ee9 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4ef0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480698.470935:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 10000000:01000000:3.0:1782480698.470940:0:6604:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1782480698.470950:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2200/0x4776e02a9acf4ee9 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ef0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480698.470957:0:6604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2200/0x4776e02a9acf4ee9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ef0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480698.470964:0:6604:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782480698.470967:0:6604:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480698.470972:0:6604:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1782480698.470974:0:6604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00000100:00100000:1.0:1782480698.470980:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388117760 00000100:00100000:1.0:1782480698.470983:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388117760 00010000:00010000:3.0:1782480698.470991:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480698.470997:0:6604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480698.471004:0:6604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480698.471012:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480698.471018:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:3312:x1869066388117760:12345-0@lo:103: 00000100:00100000:3.0:1782480698.471025:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388117888:0@lo:101: 00010000:00010000:1.0:1782480698.471027:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480698.471038:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167b600/0x4776e02a9acf4ee2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf4edb expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.471048:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480698.471051:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480698.471063:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c33cd840 going to sleep for 11 seconds 00000100:00100000:1.0:1782480698.471071:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+10:3312:x1869066388117760:12345-0@lo:103: Request processed in 53us (135us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.471077:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480698.471130:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388117888 00000100:00100000:0.0:1782480698.471134:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388117888 00000100:00100000:0.0:1782480698.471168:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1782480698.471174:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+10:6604:x1869066388117888:12345-0@lo:101: 00010000:00010000:0.0:1782480698.471188:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480698.471198:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c0030400/0x4776e02a9acf4efe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4ef7 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.471211:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c0030400/0x4776e02a9acf4efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4ef7 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.471220:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c0030400/0x4776e02a9acf4efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4ef7 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.471342:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0030400, rc 0) 00000100:00100000:0.0:1782480698.471378:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388117888:12345-0@lo:101: Request processed in 204us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480698.471383:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782480698.471492:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388117888:0@lo:101: 00010000:00010000:3.0:1782480698.471503:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480698.471510:0:6604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480698.471610:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118016:0@lo:501: 00000100:00100000:3.0:1782480698.471633:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480698.471764:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388117760:0@lo:103: 00000100:00100000:3.0:1782480698.472118:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c33cd840 going to sleep for 11 seconds 00000100:00100000:0.0:1782480698.472168:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388118016 00000100:00100000:0.0:1782480698.472174:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388118016 00000100:00100000:2.0:1782480698.472216:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782480698.472237:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388118016:12345-0@lo:501: 00000100:00100000:2.0:1782480698.472751:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388118016:12345-0@lo:501: Request processed in 515us (1104us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480698.472759:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782480698.472900:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118016:0@lo:501: 00000100:00100000:3.0:1782480698.472943:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118144:0@lo:503: 00000100:00100000:3.0:1782480698.472984:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480698.473017:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c33cd840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480698.473080:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388118144 00000100:00100000:2.0:1782480698.473085:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388118144 00000100:00100000:2.0:1782480698.473118:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782480698.473125:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388118144:12345-0@lo:503: 00000100:00100000:2.0:1782480698.473305:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388118144:12345-0@lo:503: Request processed in 179us (319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480698.473312:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1782480698.473319:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118144:0@lo:503: 00000040:00080000:1.0:1782480698.473619:0:6604:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782480698.473707:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118272:0@lo:502: 00000100:00100000:1.0:1782480698.473744:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480698.473771:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480698.473818:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388118272 00000100:00100000:3.0:1782480698.473823:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388118272 00000100:00100000:3.0:1782480698.473855:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1782480698.473861:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388118272:12345-0@lo:502: 00000100:00100000:3.0:1782480698.474005:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388118272:12345-0@lo:502: Request processed in 143us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480698.474012:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782480698.475434:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118272:0@lo:502: 00000040:00080000:1.0:1782480698.476389:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1782480698.476461:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1782480698.476496:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1782480698.476559:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1782480698.477235:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1782480698.477270:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1782480698.477375:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118400:0@lo:502: 00000100:00100000:1.0:1782480698.477451:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480698.477503:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557f0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480698.477533:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388118400 00000100:00100000:2.0:1782480698.477544:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388118400 00000100:00100000:2.0:1782480698.477655:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782480698.477691:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388118400:12345-0@lo:502: 00000100:00100000:2.0:1782480698.477900:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388118400:12345-0@lo:502: Request processed in 211us (448us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480698.477908:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1782480698.478002:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118400:0@lo:502: 00000040:00080000:0.0:1782480698.478123:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1782480698.478136:0:6604:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1782480698.480416:0:6623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782480698.480430:0:6623:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1782480698.480440:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480698.480442:0:6623:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782480698.480449:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782480698.480591:0:6623:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91d7ef048000) 00000020:00000080:2.0:1782480698.480617:0:6623:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782480698.480626:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782480698.480857:0:6623:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d7c7ca2800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1782480698.480881:0:6623:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782480698.480888:0:6623:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4776e02a9acf4f0c 00010000:00010000:2.0:1782480698.487860:0:6623:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1782480698.488231:0:6623:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1782480698.495055:0:6623:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782480698.495445:0:6623:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1782480698.515336:0:6623:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1782480698.516983:0:6623:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:0.0:1782480698.521799:0:6623:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1782480698.521816:0:6623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480698.521827:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480698.521829:0:6623:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1782480698.521834:0:6623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480698.521838:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480698.521839:0:6623:0:(obd_config.c:1561:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782480698.521842:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782480698.521844:0:6623:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782480698.521911:0:6623:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480698.521915:0:6623:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480698.521926:0:6623:0:(obd_config.c:1561:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782480698.521930:0:6623:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1782480698.531977:0:6604:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:3.0:1782480698.532022:0:6604:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1782480698.532037:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480698.532050:0:6604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480698.532719:0:6604:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c7ca2800 from 1 10000000:01000000:1.0:1782480698.532724:0:6604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480698.532776:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.532786:0:6604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.532797:0:6604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480698.532822:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118528:0@lo:101: 00000100:00100000:1.0:1782480698.532897:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480698.532946:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557f300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480698.534671:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388118528 00000100:00100000:3.0:1782480698.534685:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388118528 00000100:00100000:3.0:1782480698.534759:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782480698.534769:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:6604:x1869066388118528:12345-0@lo:101: 00010000:00010000:3.0:1782480698.534786:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480698.534802:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d802058000/0x4776e02a9acf4f1a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4f13 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480698.534828:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d802058000/0x4776e02a9acf4f1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4f13 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480698.534839:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d802058000/0x4776e02a9acf4f1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f13 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480698.534847:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d802058000, rc 0) 00000100:00100000:3.0:1782480698.534918:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388118528:12345-0@lo:101: Request processed in 150us (2021us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480698.534924:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782480698.535058:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118528:0@lo:101: 00010000:00010000:1.0:1782480698.535074:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.535083:0:6604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480698.535200:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118656:0@lo:501: 00000100:00100000:1.0:1782480698.535241:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480698.535272:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557f300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480698.536444:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388118656 00000100:00100000:3.0:1782480698.536455:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388118656 00000100:00100000:3.0:1782480698.536507:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1782480698.536517:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388118656:12345-0@lo:501: 00000100:00100000:3.0:1782480698.536813:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388118656:12345-0@lo:501: Request processed in 297us (1570us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480698.536820:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782480698.537183:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118656:0@lo:501: 00000100:00100000:2.0:1782480698.537228:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118784:0@lo:503: 00000100:00100000:2.0:1782480698.537276:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.537308:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388118784 00000100:00100000:2.0:1782480698.537312:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388118784 00000100:00100000:2.0:1782480698.537339:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782480698.537346:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388118784:12345-0@lo:503: 00000100:00100000:2.0:1782480698.537626:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388118784:12345-0@lo:503: Request processed in 279us (348us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480698.537633:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782480698.537705:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c57e73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480698.537721:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118784:0@lo:503: 00000040:00080000:2.0:1782480698.537976:0:6604:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782480698.538040:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118912:0@lo:502: 00000100:00100000:2.0:1782480698.538075:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.538103:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388118912 00000100:00100000:2.0:1782480698.538107:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388118912 00000100:00100000:2.0:1782480698.538129:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782480698.538136:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388118912:12345-0@lo:502: 00000100:00100000:2.0:1782480698.538274:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388118912:12345-0@lo:502: Request processed in 137us (197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480698.538281:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782480698.538319:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480698.538331:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388118912:0@lo:502: 00000040:00080000:2.0:1782480698.539849:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1782480698.539930:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1782480698.539974:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119040:0@lo:502: 00000100:00100000:2.0:1782480698.540038:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.540087:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388119040 00000100:00100000:2.0:1782480698.540093:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388119040 00000100:00100000:2.0:1782480698.540128:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782480698.540135:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388119040:12345-0@lo:502: 00000100:00100000:2.0:1782480698.540294:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388119040:12345-0@lo:502: Request processed in 158us (254us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480698.540302:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782480698.540357:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480698.540376:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119040:0@lo:502: 00000040:00080000:2.0:1782480698.541931:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1782480698.541954:0:6604:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:1.0:1782480698.543919:0:6627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480698.543934:0:6627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480698.543936:0:6627:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782480698.543942:0:6627:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d7c7ca2800 00000020:00000080:1.0:1782480698.543945:0:6627:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782480698.543982:0:6627:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480698.543985:0:6627:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480698.543987:0:6627:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:1.0:1782480698.543990:0:6627:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:2.0:1782480698.544243:0:6604:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1782480698.544270:0:6604:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480698.544325:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.544343:0:6604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480698.544386:0:6604:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1782480698.544400:0:6604:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d7c7ca2800 10000000:01000000:2.0:1782480698.544403:0:6604:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d7c7ca2800 10000000:01000000:2.0:1782480698.544408:0:6604:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782480698.544414:0:6604:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d7c7ca2800 from 1 10000000:01000000:2.0:1782480698.544416:0:6604:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782480698.544469:0:6604:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.544476:0:6604:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.544486:0:6604:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.544510:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119168:0@lo:101: 00000100:00100000:2.0:1782480698.544599:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.544646:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c780 going to sleep for 11 seconds 00000100:00100000:0.0:1782480698.545361:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388119168 00000100:00100000:0.0:1782480698.545371:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388119168 00000100:00100000:0.0:1782480698.545444:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782480698.545461:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388119168:12345-0@lo:101: 00010000:00010000:0.0:1782480698.545475:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480698.545489:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c0031200/0x4776e02a9acf4f28 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4f21 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.545512:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c0031200/0x4776e02a9acf4f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4f21 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.545523:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c0031200/0x4776e02a9acf4f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f21 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.545531:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0031200, rc 0) 00000100:00100000:0.0:1782480698.545596:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6604:x1869066388119168:12345-0@lo:101: Request processed in 144us (998us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480698.545603:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782480698.548207:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119168:0@lo:101: 00010000:00010000:2.0:1782480698.548236:0:6604:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.548248:0:6604:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.548420:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119296:0@lo:501: 00000100:00100000:2.0:1782480698.548499:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.548556:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480698.550540:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388119296 00000100:00100000:3.0:1782480698.550565:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388119296 00000100:00100000:3.0:1782480698.550634:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782480698.550645:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6604:x1869066388119296:12345-0@lo:501: 00000100:00100000:3.0:1782480698.551001:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6604:x1869066388119296:12345-0@lo:501: Request processed in 357us (2500us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480698.551010:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1782480698.551755:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119296:0@lo:501: 00000100:00100000:2.0:1782480698.551811:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119424:0@lo:503: 00000100:00100000:2.0:1782480698.551865:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.551902:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480698.553433:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388119424 00000100:00100000:3.0:1782480698.553446:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388119424 00000100:00100000:3.0:1782480698.553498:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1782480698.553507:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6604:x1869066388119424:12345-0@lo:503: 00000100:00100000:3.0:1782480698.553781:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6604:x1869066388119424:12345-0@lo:503: Request processed in 274us (1915us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480698.553789:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782480698.555397:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119424:0@lo:503: 00000040:00080000:0.0:1782480698.555793:0:6604:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782480698.555877:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119552:0@lo:502: 00000100:00100000:0.0:1782480698.555952:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480698.555996:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c39366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480698.556180:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388119552 00000100:00100000:2.0:1782480698.556187:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388119552 00000100:00100000:2.0:1782480698.556240:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782480698.556249:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6604:x1869066388119552:12345-0@lo:502: 00000100:00100000:2.0:1782480698.556656:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6604:x1869066388119552:12345-0@lo:502: Request processed in 407us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480698.556689:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782480698.557736:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119552:0@lo:502: 00000040:00080000:0.0:1782480698.558048:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1782480698.558107:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1782480698.558150:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1782480698.558195:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1782480698.558229:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1782480698.558287:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1782480698.558326:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1782480698.558359:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1782480698.558426:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1782480698.559854:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1782480698.559904:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1782480698.559970:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1782480698.560013:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1782480698.560072:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1782480698.560133:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1782480698.560171:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1782480698.560204:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1782480698.560253:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1782480698.560291:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1782480698.560325:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1782480698.560374:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1782480698.561968:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1782480698.562009:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1782480698.562060:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1782480698.562089:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1782480698.562120:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1782480698.562160:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1782480698.562188:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:0.0:1782480698.562237:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119680:0@lo:502: 00000100:00100000:0.0:1782480698.562326:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480698.562361:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c39366c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480698.562736:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388119680 00000100:00100000:2.0:1782480698.562754:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388119680 00000100:00100000:2.0:1782480698.562798:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782480698.562806:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6604:x1869066388119680:12345-0@lo:502: 00000100:00100000:2.0:1782480698.563015:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6604:x1869066388119680:12345-0@lo:502: Request processed in 209us (689us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480698.563022:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782480698.563806:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fce00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388119680:0@lo:502: 00000040:00080000:0.0:1782480698.563932:0:6604:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1782480698.563963:0:6604:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:3.0:1782480698.568920:0:6628:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:3.0:1782480698.568943:0:6628:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91d7ed218000) 00000020:00000080:3.0:1782480698.568968:0:6628:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1782480698.569235:0:6628:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d7c7ca2800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782480698.569240:0:6628:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d7c7ca2800 from lustre-OST0000, refs=3 00000020:01000004:0.0:1782480698.569243:0:6628:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d7c7ca2800 3 00010000:00080000:0.0:1782480698.569275:0:6628:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d7ff095000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.158@tcp at head 00010000:00010000:0.0:1782480698.578593:0:6628:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1782480698.579265:0:6628:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1782480698.579314:0:6628:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1782480698.579327:0:6628:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4776e02a9acf4f36 00000100:00080000:0.0:1782480698.579339:0:6628:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782480698.579346:0:6628:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91d7ff095000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1782480698.579383:0:6628:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7c30fce00 x1869066388119808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782480698.580828:0:6628:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782480698.581031:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1869066388119808:0@lo:38: 00000100:00100000:3.0:1782480698.581105:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000040:00080000:0.0:1782480698.581327:0:6628:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1782480698.581427:0:6604:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 00000100:00100000:1.0:1782480698.581927:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388119936:0@lo:400: 00000100:00100000:1.0:1782480698.581965:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480698.582006:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388119808 00000100:00100000:1.0:1782480698.582012:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388119808 00000100:00100000:1.0:1782480698.582035:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388119936 00000100:00100000:1.0:1782480698.582037:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388119936 00000100:00100000:1.0:1782480698.582058:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480698.582065:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388119936:12345-0@lo:400: 00000100:00100000:1.0:1782480698.582113:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388119936:12345-0@lo:400: Request processed in 46us (146us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.582120:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480698.582135:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480698.582140:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1869066388119808:12345-0@lo:38: 00010000:00080000:1.0:1782480698.582160:0:5802:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 229 last 0 00000020:00000080:1.0:1782480698.582192:0:5802:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4776e02a9acf4f3d 00000004:00100000:1.0:1782480698.582208:0:5802:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1782480698.582238:0:5802:0:(import.c:65:import_set_state_nolock()) ffff91d7ef01f800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782480698.582277:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869066388119808:12345-0@lo:38: Request processed in 135us (1172us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.582283:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782480698.582330:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d7c30fce00 x1869066388119808/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782480708 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480698.582341:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782480698.582349:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:1.0:1782480698.582369:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782480698.582374:0:3309:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782480698.582377:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7ff095000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782480698.582383:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1869066388119808:0@lo:38: 00010000:00080000:1.0:1782480698.582428:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d7c67b6680 x1869066388119936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1782480698.583602:0:6604:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782480698.583625:0:6604:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480698.583637:0:6604:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1782480698.583711:0:6604:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1782480698.583713:0:6604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782480698.583714:0:6604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480698.583715:0:6604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480698.583716:0:6604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480698.583718:0:6604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480698.583719:0:6604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480698.583721:0:6604:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480698.583726:0:6604:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480698.583727:0:6604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480698.583729:0:6604:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782480698.583732:0:6604:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1782480698.583734:0:6604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782480698.583736:0:6604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782480698.583736:0:6604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480698.583737:0:6604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480698.583738:0:6604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480698.583739:0:6604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480698.583740:0:6604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480698.583741:0:6604:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480698.583741:0:6604:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480698.583742:0:6604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480698.583743:0:6604:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1782480698.583764:0:6604:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1782480698.583780:0:6604:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388120064:0@lo:253: 00000100:00100000:0.0:1782480698.583837:0:6604:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480698.583870:0:6604:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c39366c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480698.584333:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388119936:0@lo:400: 00000100:00100000:2.0:1782480698.585581:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388120064 00000100:00100000:2.0:1782480698.585598:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388120064 00000100:00100000:2.0:1782480698.585676:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782480698.585687:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6604:x1869066388120064:12345-0@lo:253: 20000000:01000000:2.0:1782480698.585736:0:5796:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1782480698.585752:0:5796:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1782480698.619821:0:5796:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782480698.619842:0:5796:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1782480698.621708:0:5818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1782480698.621721:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1782480698.621747:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.621768:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802059800/0x4776e02a9acf4ea3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4e9c expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.621778:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.621823:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802059800/0x4776e02a9acf4ea3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4e9c expref: 13 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.621840:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d802059800/0x4776e02a9acf4ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4e9c expref: 13 pid: 5797 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.621855:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4dddf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1869066388120192:0@lo:104: 00000100:00100000:2.0:1782480698.621927:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.621983:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c535e840 going to sleep for 11 seconds 00000100:00100000:1.0:1782480698.622230:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388120192 00000100:00100000:1.0:1782480698.622238:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388120192 00000100:00100000:1.0:1782480698.622293:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782480698.622302:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:5818:x1869066388120192:12345-0@lo:104: 00010000:00010000:1.0:1782480698.622316:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.622370:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782480698.622377:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dded80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:5818:x1869066388120192:12345-0@lo:104: Request processed in 77us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.622384:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1782480698.622480:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480698.622486:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.622495:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167bc00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:1.0:1782480698.622499:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4e9c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.622526:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1782480698.622534:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4e9c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480698.622540:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1782480698.622579:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4e9c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.622586:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1782480698.622603:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4e9c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.622610:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4e9c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4ea3 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480698.622626:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480698.622627:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480698.622629:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480698.622648:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388120320:0@lo:103: 00000100:00100000:1.0:1782480698.622715:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480698.622846:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388120320 00000100:00100000:2.0:1782480698.622850:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388120320 00010000:00010000:2.0:1782480698.622868:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802059800/0x4776e02a9acf4ea3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4e9c expref: 14 pid: 5797 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.622895:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782480698.622902:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d1300c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:3311:x1869066388120320:12345-0@lo:103: 00010000:00010000:2.0:1782480698.622913:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480698.622925:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802059800/0x4776e02a9acf4ea3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4e9c expref: 14 pid: 5797 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.622935:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802059800/0x4776e02a9acf4ea3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4e9c expref: 14 pid: 5797 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.622950:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.622958:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782480698.622971:0:5787:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001349198s 00010000:00010000:2.0:1782480698.622975:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.622982:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.622989:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.622995:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.623000:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c13a3200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782480698.623004:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.623011:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.623019:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.623036:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480698.623077:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d1300c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:3311:x1869066388120320:12345-0@lo:103: Request processed in 175us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480698.623084:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1782480698.623219:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802059800/0x4776e02a9acf4ea3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4e9c expref: 13 pid: 5797 timeout: 379 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480698.623232:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4dddf80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1869066388120192:0@lo:104: 00010000:00010000:2.0:1782480698.623247:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.623256:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.623261:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480698.623267:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf4f44 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480698.623942:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388120320:0@lo:103: 00000100:00100000:1.0:1782480698.629413:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:6604:x1869066388120064:12345-0@lo:253: Request processed in 43712us (45558us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480698.629434:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782480698.630332:0:6604:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6604:1869066388120064:0@lo:253: 10000000:01000000:0.0:1782480698.630354:0:6604:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1782480698.630357:0:6604:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782480698.630359:0:6604:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1782480698.630360:0:6604:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480698.630362:0:6604:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480698.630363:0:6604:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480698.630364:0:6604:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480698.630366:0:6604:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480698.630367:0:6604:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480698.630369:0:6604:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480698.630371:0:6604:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480698.630372:0:6604:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1782480698.630404:0:6604:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1782480698.635495:0:6604:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480698.635711:0:6604:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1782480698.636198:0:6604:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480698.636381:0:6604:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1782480698.636695:0:6604:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1782480698.637263:0:6604:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1782480698.639202:0:6604:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1782480698.958216:0:6604:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:0.0:1782480698.958226:0:6604:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:0.0:1782480698.958269:0:6604:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782480698.958342:0:6604:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782480698.958371:0:6604:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:0.0:1782480698.958413:0:6604:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:1.0:1782480699.317416:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480700.324704:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480701.348967:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480702.375882:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480703.395938:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480703.906610:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388120576:0@lo:400: 00000100:00100000:0.0:1782480703.906734:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480703.906802:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480703.906810:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388120448:0@lo:400: 00000100:00100000:0.0:1782480703.906846:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480703.906880:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388120704:0@lo:400: 00000100:00100000:0.0:1782480703.906909:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480703.906964:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388120576 00000100:00100000:0.0:1782480703.906974:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388120576 00000100:00100000:0.0:1782480703.907027:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388120704 00000100:00100000:0.0:1782480703.907030:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388120704 00000100:00100000:0.0:1782480703.907070:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480703.907079:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388120576:12345-0@lo:400: 00000100:00100000:0.0:1782480703.907145:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388120576:12345-0@lo:400: Request processed in 66us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480703.907153:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480703.907173:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480703.907181:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388120704:12345-0@lo:400: 00000100:00100000:0.0:1782480703.907214:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388120704:12345-0@lo:400: Request processed in 34us (303us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480703.907232:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480703.907252:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388120448 00000100:00100000:0.0:1782480703.907256:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388120448 00000100:00100000:0.0:1782480703.907281:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1782480703.907288:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:3313:x1869066388120448:12345-0@lo:400: 00000100:00100000:0.0:1782480703.907319:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:3313:x1869066388120448:12345-0@lo:400: Request processed in 33us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480703.907326:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:0.0:1782480703.907408:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c30ff480 x1869066388120704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480703.907424:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388120704:0@lo:400: 00000100:00100000:0.0:1782480703.907465:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388120448:0@lo:400: 00010000:00080000:0.0:1782480703.907478:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c30fed80 x1869066388120576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480719 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480703.907486:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388120576:0@lo:400: 00000100:00080000:1.0:1782480703.908058:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 10000000:01000000:1.0:1782480704.415505:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782480704.415516:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d7c52cd800 from 21 10000000:01000000:1.0:1782480704.415540:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782480704.415606:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480704.415620:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480704.415635:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480704.415685:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388120832:0@lo:101: 00000100:00100000:1.0:1782480704.415807:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.424984:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480704.429364:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388120832 00000100:00100000:3.0:1782480704.429387:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388120832 00010000:00010000:0.0:1782480704.429514:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480704.429570:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1782480704.429586:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5799:x1869066388120832:12345-0@lo:101: 00010000:00010000:0.0:1782480704.429611:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480704.429635:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c0031a00/0x4776e02a9acf4f52 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4f4b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480704.429692:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c0031a00/0x4776e02a9acf4f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4f4b expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480704.430057:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c0031a00/0x4776e02a9acf4f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f4b expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480704.430068:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0031a00, rc 0) 00000100:00100000:0.0:1782480704.430195:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388120832:12345-0@lo:101: Request processed in 614us (14389us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480704.430204:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1782480704.430505:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388120832:0@lo:101: 00010000:00010000:1.0:1782480704.430530:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480704.430541:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480704.430640:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388120960:0@lo:501: 00000100:00100000:1.0:1782480704.430727:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.430795:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480704.430944:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388120960 00000100:00100000:0.0:1782480704.430952:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388120960 00000100:00100000:0.0:1782480704.431000:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782480704.431010:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388120960:12345-0@lo:501: 00000100:00100000:0.0:1782480704.431422:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388120960:12345-0@lo:501: Request processed in 412us (694us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480704.431429:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782480704.431652:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388120960:0@lo:501: 00000100:00100000:1.0:1782480704.431723:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121088:0@lo:503: 00000100:00100000:1.0:1782480704.431769:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.431798:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557fcc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480704.431934:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388121088 00000100:00100000:0.0:1782480704.431939:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388121088 00000100:00100000:0.0:1782480704.431978:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782480704.431987:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388121088:12345-0@lo:503: 00000100:00100000:0.0:1782480704.432212:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388121088:12345-0@lo:503: Request processed in 226us (442us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480704.432220:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782480704.432725:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121088:0@lo:503: 00000100:00100000:1.0:1782480704.433869:0:6834:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6834:1869066388121216:0@lo:502: 00000100:00100000:1.0:1782480704.433955:0:6834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.434006:0:6834:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557f300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480704.434167:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388121216 00000100:00100000:0.0:1782480704.434176:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388121216 00000100:00100000:0.0:1782480704.434233:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1782480704.434243:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6834:x1869066388121216:12345-0@lo:502: 00000100:00100000:0.0:1782480704.435231:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6834:x1869066388121216:12345-0@lo:502: Request processed in 982us (1269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480704.435249:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782480704.435331:0:6834:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6834:1869066388121216:0@lo:502: 00000100:00100000:1.0:1782480704.435411:0:6834:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6834:1869066388121344:0@lo:502: 00000100:00100000:1.0:1782480704.435470:0:6834:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.435513:0:6834:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557f300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480704.435693:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388121344 00000100:00100000:3.0:1782480704.435715:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388121344 00000100:00100000:3.0:1782480704.435762:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782480704.435772:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6834:x1869066388121344:12345-0@lo:502: 00000100:00100000:3.0:1782480704.436022:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:6834:x1869066388121344:12345-0@lo:502: Request processed in 251us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480704.436029:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1782480704.436178:0:6834:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6834:1869066388121344:0@lo:502: 00000040:00080000:0.0:1782480704.436209:0:6834:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1782480704.436845:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1782480704.436875:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782480704.436891:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480704.436905:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480704.436917:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1782480704.436920:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91d7c52cd800 from 4 10000000:01000000:1.0:1782480704.436923:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782480704.436964:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480704.436972:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480704.436982:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480704.437002:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121472:0@lo:101: 00000100:00100000:1.0:1782480704.437063:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.437097:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480704.437218:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388121472 00000100:00100000:0.0:1782480704.437227:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388121472 00000100:00100000:0.0:1782480704.437270:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782480704.437281:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388121472:12345-0@lo:101: 00010000:00010000:0.0:1782480704.437295:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480704.437313:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c0030200/0x4776e02a9acf4f60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4f59 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480704.437340:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c0030200/0x4776e02a9acf4f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4f59 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480704.437353:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c0030200/0x4776e02a9acf4f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f59 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480704.437364:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0030200, rc 0) 00000100:00100000:0.0:1782480704.437478:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388121472:12345-0@lo:101: Request processed in 197us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480704.437485:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782480704.438544:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121472:0@lo:101: 00010000:00010000:1.0:1782480704.438577:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480704.438676:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480704.438757:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121600:0@lo:256: 00000100:00100000:1.0:1782480704.439050:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.439178:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557f0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480704.439249:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388121600 00000100:00100000:0.0:1782480704.439259:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388121600 00000100:00100000:0.0:1782480704.439331:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782480704.439342:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388121600:12345-0@lo:256: 20000000:01000000:0.0:1782480704.439372:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782480704.439394:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782480704.439402:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:1.0:1782480704.440043:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388121600:12345-0@lo:256: Request processed in 699us (991us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480704.440053:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782480704.440141:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121600:0@lo:256: 10000000:01000000:0.0:1782480704.440197:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782480704.440209:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480704.440221:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480704.440231:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1782480704.440234:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1782480704.440236:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1782480704.440302:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480704.440311:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480704.440322:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480704.440348:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121728:0@lo:101: 00000100:00100000:0.0:1782480704.440381:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480704.440418:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794540 going to sleep for 11 seconds 00000100:00100000:3.0:1782480704.440497:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388121728 00000100:00100000:3.0:1782480704.440505:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388121728 00000100:00100000:3.0:1782480704.440547:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782480704.440557:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388121728:12345-0@lo:101: 00010000:00010000:3.0:1782480704.440570:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480704.440587:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d802059800/0x4776e02a9acf4f6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4f67 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480704.440613:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d802059800/0x4776e02a9acf4f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4f67 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480704.440625:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d802059800/0x4776e02a9acf4f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f67 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480704.440635:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d802059800, rc 0) 00000100:00100000:0.0:1782480704.440739:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121728:0@lo:101: 00000100:00100000:3.0:1782480704.440741:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388121728:12345-0@lo:101: Request processed in 183us (356us total) trans 0 rc 0/0 00010000:00010000:0.0:1782480704.440757:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480704.440764:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00010000:0.0:1782480704.440958:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480704.441021:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121856:0@lo:501: 00000100:00100000:0.0:1782480704.441048:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480704.441125:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794540 going to sleep for 11 seconds 00000100:00100000:1.0:1782480704.441154:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388121856 00000100:00100000:1.0:1782480704.441158:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388121856 00000100:00100000:1.0:1782480704.441216:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782480704.441223:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388121856:12345-0@lo:501: 00000100:00100000:1.0:1782480704.441989:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388121856:12345-0@lo:501: Request processed in 763us (936us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480704.441998:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782480704.442549:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121856:0@lo:501: 00000100:00100000:0.0:1782480704.442741:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121984:0@lo:503: 00000100:00100000:1.0:1782480704.443348:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.443396:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794540 going to sleep for 11 seconds 00000100:00100000:3.0:1782480704.443494:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388121984 00000100:00100000:3.0:1782480704.443501:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388121984 00000100:00100000:3.0:1782480704.443545:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782480704.443567:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388121984:12345-0@lo:503: 00000100:00100000:3.0:1782480704.444041:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388121984:12345-0@lo:503: Request processed in 475us (761us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480704.444050:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782480704.444084:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388121984:0@lo:503: 00000100:00100000:1.0:1782480704.444736:0:6835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6835:1869066388122112:0@lo:502: 00000100:00100000:1.0:1782480704.444982:0:6835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.445028:0:6835:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c557f300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480704.445141:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388122112 00000100:00100000:2.0:1782480704.445148:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388122112 00000100:00100000:2.0:1782480704.445182:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782480704.445192:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:6835:x1869066388122112:12345-0@lo:502: 00000100:00100000:2.0:1782480704.445462:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:6835:x1869066388122112:12345-0@lo:502: Request processed in 270us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480704.445471:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782480704.445489:0:6835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b7b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6835:1869066388122112:0@lo:502: 00000020:01000000:1.0:1782480704.445519:0:6835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782480704.445530:0:6835:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782480704.445540:0:6835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480704.445542:0:6835:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1782480704.445548:0:6835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782480704.445552:0:6835:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:1.0:1782480704.445650:0:6835:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782480704.445654:0:6835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782480704.445705:0:6835:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91d7f4cc3380) 00000020:00000080:1.0:1782480704.445731:0:6835:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:1.0:1782480704.445738:0:6835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782480704.446053:0:6835:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1782480704.446060:0:6835:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782480704.446069:0:6835:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf4f7c 00010000:00080000:1.0:1782480704.446108:0:6835:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d7eca08000@lustre-OST0000-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1782480704.446400:0:6835:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1782480704.484373:0:6835:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1782480704.484403:0:6835:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1782480704.486055:0:6835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480704.486219:0:6835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480704.486263:0:6835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1782480704.487010:0:6835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:1.0:1782480704.487718:0:6838:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480704.487725:0:6838:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:2.0:1782480704.488734:0:6835:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782480704.488751:0:6835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1782480704.489266:0:6835:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:2.0:1782480704.489352:0:6835:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4776e02a9acf4f83 00000100:00080000:2.0:1782480704.489367:0:6835:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1782480704.489374:0:6835:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d7eca08000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1782480704.489423:0:6835:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7f4dddf80 x1869066388122240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782480704.489464:0:6835:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00100000:1.0:1782480704.489556:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388122240:0@lo:8: 00000100:00100000:1.0:1782480704.489652:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:01000000:2.0:1782480704.489760:0:6835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480704.489777:0:6835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480704.489779:0:6835:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:2.0:1782480704.489783:0:6835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480704.489788:0:6835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480704.489796:0:6835:0:(obd_config.c:1561:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782480704.489799:0:6835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782480704.489802:0:6835:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782480704.489831:0:6835:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6835:1869066388122368:0@lo:502: 00000100:00100000:2.0:1782480704.489884:0:6835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480704.489948:0:6835:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c5760480 going to sleep for 11 seconds 00000100:00100000:3.0:1782480704.489989:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388122368 00000100:00100000:3.0:1782480704.489998:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388122368 00000100:00100000:3.0:1782480704.490048:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782480704.490058:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:6835:x1869066388122368:12345-0@lo:502: 00000100:00100000:2.0:1782480704.490233:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388122496:0@lo:400: 00000100:00100000:2.0:1782480704.490270:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480704.490400:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480704.490410:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388122624:0@lo:400: 00000100:00100000:3.0:1782480704.490428:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:6835:x1869066388122368:12345-0@lo:502: Request processed in 370us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480704.490437:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1782480704.490462:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480704.490495:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388122496 00000100:00100000:0.0:1782480704.490498:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388122496 00000100:00100000:3.0:1782480704.490527:0:6835:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddea00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:6835:1869066388122368:0@lo:502: 00000100:00100000:0.0:1782480704.490527:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388122624 00000100:00100000:0.0:1782480704.490529:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388122624 00000100:00100000:0.0:1782480704.490545:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000020:01000000:3.0:1782480704.490556:0:6835:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480704.490561:0:6835:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480704.490563:0:6835:0:(obd_config.c:1561:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1782480704.490567:0:6835:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:3.0:1782480704.490812:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:3.0:1782480704.490844:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782480704.490856:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480704.491121:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388122496:12345-0@lo:400: 00010000:00010000:3.0:1782480704.491143:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480704.491171:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782480704.491174:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91d7c2d04d40 from 1 10000000:01000000:3.0:1782480704.491176:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782480704.491208:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480704.491218:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480704.491228:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480704.491245:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388122752:0@lo:101: 00000100:00100000:1.0:1782480704.491317:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388122240 00000100:00100000:1.0:1782480704.491324:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388122240 00000100:00100000:1.0:1782480704.491351:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480704.491357:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480704.491357:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1869066388122240:12345-0@lo:8: 00000100:00100000:3.0:1782480704.491375:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c3c0 going to sleep for 11 seconds 00010000:00080000:1.0:1782480704.491384:0:6607:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 235 last 0 00000100:00100000:3.0:1782480704.491396:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388122752 00000100:00100000:3.0:1782480704.491399:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388122752 00000100:00100000:3.0:1782480704.491421:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000020:00000080:1.0:1782480704.491421:0:6607:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4776e02a9acf4f91 00000100:00100000:3.0:1782480704.491427:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388122752:12345-0@lo:101: 00010000:00010000:3.0:1782480704.491436:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480704.491462:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d802059000/0x4776e02a9acf4f98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4f8a expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00100000:1.0:1782480704.491483:0:6607:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91d6c29a6800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113662 ocd_grant: 0 ocd_index: 0 ocd_group 0 00010000:00010000:3.0:1782480704.491486:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d802059000/0x4776e02a9acf4f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4f8a expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782480704.491493:0:6607:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1782480704.491498:0:6607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1782480704.491499:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d802059000/0x4776e02a9acf4f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f8a expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480704.491518:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d802059000, rc 0) 00000100:00100000:3.0:1782480704.491548:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388122752:12345-0@lo:101: Request processed in 120us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480704.491554:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00002000:00100000:1.0:1782480704.491677:0:6607:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:3.0:1782480704.491682:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388122752:0@lo:101: 00010000:00010000:3.0:1782480704.491696:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480704.491706:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480704.491751:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388122880:0@lo:501: 00000100:00100000:3.0:1782480704.491776:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480704.491794:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480704.491807:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388122880 00000100:00100000:3.0:1782480704.491810:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388122880 00000100:00100000:3.0:1782480704.491829:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782480704.491846:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388122880:12345-0@lo:501: 00002000:00080000:1.0:1782480704.491861:0:6607:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782480704.491893:0:6607:0:(import.c:65:import_set_state_nolock()) ffff91d6c29a7800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782480704.491936:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1869066388122240:12345-0@lo:8: Request processed in 578us (2285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480704.491942:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782480704.491975:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7f4dddf80 x1869066388122240/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782480714 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480704.491987:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782480704.491995:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:1.0:1782480704.492004:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1782480704.492010:0:3309:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:1.0:1782480704.492013:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7eca08000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1782480704.492028:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1782480704.492035:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4dddf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388122240:0@lo:8: 00000004:00080000:1.0:1782480704.492057:0:6838:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782480704.492159:0:6838:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 235053499652ns, next at 0ns, rc = 0 00000100:00100000:3.0:1782480704.492193:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388122880:12345-0@lo:501: Request processed in 357us (416us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782480704.492201:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1782480704.492232:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388122880:0@lo:501: 10000000:01000000:3.0:1782480704.492253:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782480704.492259:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480704.492355:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480704.492882:0:5804:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1782480704.492894:0:5804:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1782480704.492989:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388122496:12345-0@lo:400: Request processed in 1870us (2714us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480704.492998:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480704.493032:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782480704.493044:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388122624:12345-0@lo:400: 00000100:00100000:0.0:1782480704.493113:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388122624:12345-0@lo:400: Request processed in 73us (2669us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480704.493119:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1782480704.493193:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c30ff480 x1869066388122624/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480704.493204:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388122624:0@lo:400: 00010000:00080000:2.0:1782480704.493461:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c30fd500 x1869066388122496/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480720 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480704.493486:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388122496:0@lo:400: 00000004:00080000:0.0:1782480704.586613:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:2.0:1782480704.626510:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388123008:0@lo:13: 00000100:00100000:2.0:1782480704.626618:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:0.0:1782480704.626771:0:6839:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:0.0:1782480704.626804:0:6839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1869066388123136:0@lo:7: 00000100:00100000:0.0:1782480704.626864:0:6839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480704.626885:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388123008 00000100:00100000:3.0:1782480704.626896:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388123008 00000100:00100000:0.0:1782480704.626901:0:6839:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d6d58240 going to sleep for 11 seconds 00000100:00100000:3.0:1782480704.626976:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480704.626989:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1869066388123008:12345-0@lo:13: 00002000:00000024:3.0:1782480704.627034:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1782480704.627096:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1869066388123008:12345-0@lo:13: Request processed in 109us (477us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480704.627104:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782480704.627161:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c30fc380 x1869066388123008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480720 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480704.627183:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388123008:0@lo:13: 00000100:00100000:2.0:1782480704.627467:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388123136 00000100:00100000:2.0:1782480704.627472:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388123136 00000100:00100000:2.0:1782480704.627509:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782480704.627516:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6839:x1869066388123136:12345-0@lo:7: 00000100:00080000:1.0:1782480704.629009:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1782480704.646269:0:6609:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1782480704.647273:0:6609:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1782480704.650240:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6839:x1869066388123136:12345-0@lo:7: Request processed in 22710us (23361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480704.650258:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1782480704.650598:0:6839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c30fe300 x1869066388123136/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782480720 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480704.650618:0:6839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1869066388123136:0@lo:7: 00000004:00080000:0.0:1782480704.650635:0:6839:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:0.0:1782480704.651370:0:6839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1869066388123264:0@lo:5: 00000100:00100000:0.0:1782480704.651452:0:6839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480704.651524:0:6839:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d6d58240 going to sleep for 11 seconds 00000100:00100000:1.0:1782480704.653336:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388123264 00000100:00100000:1.0:1782480704.653356:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388123264 00000100:00100000:1.0:1782480704.653481:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480704.653494:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6839:x1869066388123264:12345-0@lo:5: 00002000:00080000:1.0:1782480704.653545:0:6607:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1782480704.653550:0:6607:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1782480704.654161:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6839:x1869066388123264:12345-0@lo:5: Request processed in 668us (2717us total) trans 4294967297 rc 0/0 00010000:00080000:0.0:1782480704.654954:0:6839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c30fe300 x1869066388123264/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782480720 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480704.654978:0:6839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fe300 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1869066388123264:0@lo:5: 00000004:00080000:0.0:1782480704.654994:0:6839:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:0.0:1782480704.655051:0:6839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1869066388123392:0@lo:700: 00000100:00100000:0.0:1782480704.655100:0:6839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480704.655154:0:6839:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d6d58240 going to sleep for 11 seconds 00000100:00100000:1.0:1782480704.655456:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480704.655740:0:6615:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388123392 00000100:00100000:0.0:1782480704.655749:0:6615:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388123392 00000100:00100000:0.0:1782480704.655805:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480704.655815:0:6615:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6839:x1869066388123392:12345-0@lo:700: 00000100:00100000:0.0:1782480704.655866:0:6615:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6615:1869066388123520:0@lo:700: 00000100:00100000:0.0:1782480704.655907:0:6615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480704.655932:0:6615:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d6d583c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480704.655950:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388123520 00000100:00100000:3.0:1782480704.655957:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388123520 00000100:00100000:3.0:1782480704.656001:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480704.656010:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6615:x1869066388123520:12345-0@lo:700: 40000000:02000000:2.0:1782480704.770552:0:5809:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:3.0:1782480704.789536:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6615:x1869066388123520:12345-0@lo:700: Request processed in 133514us (133615us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480704.789558:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782480704.789694:0:6615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c30fd500 x1869066388123520/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782480720 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480704.789716:0:6615:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6615:1869066388123520:0@lo:700: 40000000:02000000:3.0:1782480704.789742:0:6615:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1782480704.970332:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1782480704.970362:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1782480704.974188:0:6615:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6839:x1869066388123392:12345-0@lo:700: Request processed in 318357us (319070us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480704.974217:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1782480704.974955:0:6839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c30fea00 x1869066388123392/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782480720 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480704.974986:0:6839:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1782480704.975206:0:6839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1869066388123392:0@lo:700: 00000004:02000040:3.0:1782480705.027950:0:6839:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1782480705.032136:0:6839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1869066388123648:0@lo:5: 00000100:00100000:3.0:1782480705.032240:0:6839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480705.032457:0:6839:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c52f2000 going to sleep for 11 seconds 00000100:00100000:0.0:1782480705.032543:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388123648 00000100:00100000:0.0:1782480705.032553:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388123648 00000100:00100000:0.0:1782480705.032693:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480705.032706:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:6839:x1869066388123648:12345-0@lo:5: 00002000:00080000:0.0:1782480705.046226:0:6607:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1782480705.046259:0:6607:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1782480705.062788:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6839:x1869066388123648:12345-0@lo:5: Request processed in 30070us (30534us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1782480705.062807:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782480705.062885:0:6839:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b3480 x1869066388123648/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782480721 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480705.062909:0:6839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3480 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6839:1869066388123648:0@lo:5: 00000004:00080000:1.0:1782480705.062930:0:6839:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:0.0:1782480705.442711:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480706.463856:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480707.490840:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782480707.686219:0:6980:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782480708.522565:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480709.535759:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480709.539953:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388124032:0@lo:400: 00000100:00100000:2.0:1782480709.540054:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388123776:0@lo:400: 00000100:00100000:1.0:1782480709.540064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480709.540138:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480709.540208:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480709.540216:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388123904:0@lo:400: 00000100:00100000:2.0:1782480709.540253:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480709.540294:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388123776 00000100:00100000:2.0:1782480709.540316:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388123776 00000100:00100000:2.0:1782480709.540403:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782480709.540416:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3310:x1869066388123776:12345-0@lo:400: 00000100:00100000:2.0:1782480709.540478:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3310:x1869066388123776:12345-0@lo:400: Request processed in 65us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480709.540486:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1782480709.540552:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388124032 00000100:00100000:2.0:1782480709.540556:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388124032 00000100:00100000:2.0:1782480709.540590:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388123904 00000100:00100000:2.0:1782480709.540593:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388123904 00000100:00100000:2.0:1782480709.540610:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480709.540615:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388124032:12345-0@lo:400: 00000100:00100000:2.0:1782480709.540649:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388124032:12345-0@lo:400: Request processed in 34us (586us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480709.540656:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480709.540693:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782480709.540699:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388123904:12345-0@lo:400: 00000100:00100000:2.0:1782480709.540725:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388123904:12345-0@lo:400: Request processed in 27us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480709.540731:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1782480709.540783:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c67b6a00 x1869066388123904/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480709.540799:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388123904:0@lo:400: 00000100:00100000:2.0:1782480709.540824:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388123776:0@lo:400: 00010000:00080000:1.0:1782480709.549744:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c67b6680 x1869066388124032/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480709.549769:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388124032:0@lo:400: 00000100:00100000:1.0:1782480709.549806:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480709.549821:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388124160:0@lo:400: 00000100:00100000:1.0:1782480709.549909:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1782480709.549950:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480709.549974:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388124160 00000100:00100000:1.0:1782480709.550011:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388124160 00000100:00100000:1.0:1782480709.550083:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782480709.550094:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388124160:12345-0@lo:400: 00000100:00080000:3.0:1782480709.550123:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480709.550174:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388124160:12345-0@lo:400: Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480709.550183:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782480709.550205:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c67b5880 x1869066388124160/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480725 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480709.550217:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388124160:0@lo:400: 00000100:00100000:2.0:1782480710.047772:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388124288:0@lo:13: 00000100:00100000:2.0:1782480710.047878:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480710.047978:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388124288 00000100:00100000:3.0:1782480710.047990:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388124288 00000100:00100000:3.0:1782480710.048054:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480710.048065:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388124288:12345-0@lo:13: 00002000:00000024:3.0:1782480710.048106:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480710.048237:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388124288:12345-0@lo:13: Request processed in 172us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480710.048245:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782480710.048294:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7f4ddd880 x1869066388124288/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480726 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480710.048316:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388124288:0@lo:13: 00000001:00080000:2.0:1782480710.182492:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1782480710.559591:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480711.583121:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480712.626990:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480713.639112:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480714.654898:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480714.669205:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388124416:0@lo:400: 00000100:00100000:0.0:1782480714.669311:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480714.669427:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388124416 00000100:00100000:3.0:1782480714.669438:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388124416 00000100:00100000:3.0:1782480714.669622:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782480714.669636:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3311:x1869066388124416:12345-0@lo:400: 00000100:00100000:3.0:1782480714.671257:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3311:x1869066388124416:12345-0@lo:400: Request processed in 1614us (1935us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480714.671283:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782480714.671347:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388124800:0@lo:400: 00000100:00100000:3.0:1782480714.671405:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480714.671459:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388124544:0@lo:400: 00000100:00100000:3.0:1782480714.671491:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480714.671521:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480714.671528:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388124672:0@lo:400: 00000100:00100000:3.0:1782480714.671553:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480714.671596:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388124544 00000100:00100000:3.0:1782480714.671605:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388124544 00000100:00100000:3.0:1782480714.671648:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388124672 00000100:00100000:3.0:1782480714.671652:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388124672 00000100:00100000:1.0:1782480714.671759:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388124800 00000100:00100000:1.0:1782480714.671764:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388124800 00000100:00100000:1.0:1782480714.671811:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480714.671820:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388124800:12345-0@lo:400: 00000100:00100000:1.0:1782480714.671882:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388124800:12345-0@lo:400: Request processed in 63us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480714.671889:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480714.672170:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782480714.672179:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388124544:12345-0@lo:400: 00000100:00100000:3.0:1782480714.672237:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388124544:12345-0@lo:400: Request processed in 59us (744us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480714.672244:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782480714.672256:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782480714.672274:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388124672:12345-0@lo:400: 00000100:00100000:3.0:1782480714.672310:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388124672:12345-0@lo:400: Request processed in 48us (756us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480714.672333:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782480714.672510:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388124416:0@lo:400: 00000100:00080000:3.0:1782480714.674368:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480714.674379:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782480714.674512:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7f4ddfb80 x1869066388124800/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480714.674527:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782480714.674546:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388124800:0@lo:400: 00010000:00080000:3.0:1782480714.674586:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7f4ddce00 x1869066388124672/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480714.674598:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388124672:0@lo:400: 00010000:00080000:3.0:1782480714.674614:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7f4ddc700 x1869066388124544/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480714.674623:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388124544:0@lo:400: 00000100:00100000:3.0:1782480715.168401:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388124928:0@lo:13: 00000100:00100000:3.0:1782480715.168508:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480715.168717:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388124928 00000100:00100000:1.0:1782480715.168728:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388124928 00000100:00100000:1.0:1782480715.168792:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480715.168804:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388124928:12345-0@lo:13: 00002000:00000024:1.0:1782480715.168856:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480715.168913:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388124928:12345-0@lo:13: Request processed in 111us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480715.168921:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782480715.169879:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c67b6300 x1869066388124928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480731 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480715.169907:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388124928:0@lo:13: 00010000:00010000:1.0:1782480715.680009:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480716.702883:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480717.727301:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480718.751941:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480719.775504:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480719.775841:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388125312:0@lo:400: 00000100:00100000:1.0:1782480719.776047:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388125056:0@lo:400: 00000100:00100000:1.0:1782480719.776116:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480719.776193:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480719.776219:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388125184:0@lo:400: 00000100:00100000:1.0:1782480719.776254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480719.776307:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388125056 00000100:00100000:1.0:1782480719.776316:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388125056 00000100:00100000:1.0:1782480719.776381:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782480719.776389:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3312:x1869066388125056:12345-0@lo:400: 00000100:00100000:1.0:1782480719.776453:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3312:x1869066388125056:12345-0@lo:400: Request processed in 64us (344us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480719.776468:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1782480719.776506:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388125184 00000100:00100000:1.0:1782480719.776510:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388125184 00000100:00100000:1.0:1782480719.776543:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480719.776556:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388125184:12345-0@lo:400: 00000100:00100000:2.0:1782480719.777265:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388125440:0@lo:400: 00000100:00100000:2.0:1782480719.777306:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480719.777406:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388125056:0@lo:400: 00000100:00100000:1.0:1782480719.777727:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388125184:12345-0@lo:400: Request processed in 1170us (1471us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480719.777743:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782480719.777760:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388125440 00000100:00100000:0.0:1782480719.777765:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388125440 00000100:00100000:0.0:1782480719.777813:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480719.777821:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388125440:12345-0@lo:400: 00000100:00080000:1.0:1782480719.777894:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480719.778140:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480719.778372:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388125312 00000100:00100000:1.0:1782480719.778377:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388125312 00000100:00100000:1.0:1782480719.778418:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480719.778425:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388125312:12345-0@lo:400: 00000100:00100000:1.0:1782480719.778465:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388125312:12345-0@lo:400: Request processed in 40us (324us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480719.778471:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1782480719.780236:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b2680 x1869066388125184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480719.780254:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388125184:0@lo:400: 00010000:00080000:2.0:1782480719.780311:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b3800 x1869066388125312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480719.780320:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388125312:0@lo:400: 00000100:00100000:2.0:1782480719.780506:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388125440:12345-0@lo:400: Request processed in 2684us (3197us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480719.780515:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1782480719.780610:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b2a00 x1869066388125440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480735 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480719.780628:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388125440:0@lo:400: 00000100:00080000:3.0:1782480719.781156:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:01000004:1.0:1782480720.238120:0:7499:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:1.0:1782480720.238126:0:7499:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1782480720.238305:0:7499:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91d6c29a2000 00000020:01000004:1.0:1782480720.238327:0:7499:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1782480720.238345:0:7499:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1782480720.238364:0:7499:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91d7f4cc4d40) 00000020:00000080:1.0:1782480720.238386:0:7499:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1782480720.261377:0:7499:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:0.0:1782480720.261696:0:7499:0:(scrub.c:229:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1782480720.280081:0:7499:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:1.0:1782480720.284298:0:7499:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:1.0:1782480720.284334:0:7499:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:1.0:1782480720.284391:0:7499:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:1.0:1782480720.284416:0:7499:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:1.0:1782480720.284834:0:7499:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:1.0:1782480720.284847:0:7499:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:1.0:1782480720.284858:0:7499:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4776e02a9acf4fa6 00000020:01000004:1.0:1782480720.284867:0:7499:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:1.0:1782480720.284891:0:7499:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:1.0:1782480720.284895:0:7499:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:1.0:1782480720.284901:0:7499:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:1.0:1782480720.284923:0:7499:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:1.0:1782480720.284927:0:7499:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000100:00100000:3.0:1782480720.286889:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388125568:0@lo:13: 00000100:00100000:3.0:1782480720.286970:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480720.287091:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388125568 00000100:00100000:2.0:1782480720.287100:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388125568 00000100:00100000:2.0:1782480720.287150:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782480720.287160:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388125568:12345-0@lo:13: 00002000:00000024:2.0:1782480720.287203:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480720.287257:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388125568:12345-0@lo:13: Request processed in 98us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.287264:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1782480720.287304:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7f4ddf800 x1869066388125568/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480736 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480720.287322:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388125568:0@lo:13: 00000040:01000000:0.0:1782480720.314495:0:7499:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:0.0:1782480720.314536:0:7499:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.158@tcp, index=0001, flags=0x20062 00000020:01000004:0.0:1782480720.314541:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1782480720.314543:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782480720.314545:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480720.314546:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480720.314548:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480720.314549:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480720.314555:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480720.314556:0:7499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480720.314557:0:7499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480720.314559:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480720.314560:0:7499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782480720.314564:0:7499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:0.0:1782480720.314566:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1782480720.314567:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782480720.314569:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480720.314569:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1782480720.314570:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480720.314571:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480720.314572:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480720.314573:0:7499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1782480720.314574:0:7499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1782480720.314574:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480720.314575:0:7499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1782480720.314602:0:7499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:0.0:1782480720.314622:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388125696:0@lo:253: 00000100:00100000:0.0:1782480720.314779:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480720.314895:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6728540 going to sleep for 11 seconds 00000100:00100000:3.0:1782480720.315011:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388125696 00000100:00100000:3.0:1782480720.315019:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388125696 00000100:00100000:3.0:1782480720.315118:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782480720.315127:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:7499:x1869066388125696:12345-0@lo:253: 20000000:01000000:3.0:1782480720.315178:0:5794:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:3.0:1782480720.315183:0:5794:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:3.0:1782480720.315189:0:5794:0:(mgs_llog.c:867:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:3.0:1782480720.315192:0:5794:0:(mgs_llog.c:3853:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:3.0:1782480720.316161:0:5794:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480720.316384:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:3.0:1782480720.316399:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:3.0:1782480720.316437:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:3.0:1782480720.316444:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:3.0:1782480720.316471:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:3.0:1782480720.316519:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:3.0:1782480720.316934:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:3.0:1782480720.316955:0:5794:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:3.0:1782480720.316957:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:3.0:1782480720.317004:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:3.0:1782480720.317012:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1782480720.317061:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:3.0:1782480720.317070:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:3.0:1782480720.317100:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:3.0:1782480720.317108:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1782480720.317136:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:3.0:1782480720.317198:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:3.0:1782480720.317964:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:3.0:1782480720.317982:0:5794:0:(mgs_llog.c:3806:mgs_write_log_osc_to_lov()) add nid 192.168.201.158@tcp 20000000:01000000:3.0:1782480720.317984:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg (null) 0xcf005 192.168.201.158@tcp (null) (null) (null) 00000040:00080000:3.0:1782480720.318017:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:3.0:1782480720.318032:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:3.0:1782480720.318067:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:3.0:1782480720.318074:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.201.158@tcp (null) (null) 00000040:00080000:3.0:1782480720.318104:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:3.0:1782480720.318112:0:5794:0:(mgs_llog.c:1536:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:3.0:1782480720.318648:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:3.0:1782480720.318884:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:3.0:1782480720.319016:0:5794:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:3.0:1782480720.319020:0:5794:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:3.0:1782480720.319024:0:5794:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:3.0:1782480720.319039:0:5794:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782480720.319042:0:5794:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1782480720.319082:0:5794:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1782480720.319085:0:5794:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1782480720.319607:0:7501:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:0.0:1782480720.319821:0:7501:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:0.0:1782480720.319892:0:7501:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:3.0:1782480720.320225:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:3.0:1782480720.320263:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:3.0:1782480720.320319:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:3.0:1782480720.320332:0:5794:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1782480720.320334:0:5794:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1782480720.320774:0:7502:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:3.0:1782480720.321095:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:3.0:1782480720.321134:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:3.0:1782480720.321223:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:3.0:1782480720.321235:0:5794:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:3.0:1782480720.321237:0:5794:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1782480720.326566:0:7503:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1782480720.326731:0:7503:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1782480720.326765:0:7503:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:3.0:1782480720.327209:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:3.0:1782480720.327257:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:3.0:1782480720.327320:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:3.0:1782480720.327335:0:5794:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1782480720.327337:0:5794:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1782480720.332381:0:7504:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1782480720.332478:0:7504:0:(mgs_llog.c:1073:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1782480720.332535:0:7504:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1782480720.332911:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1782480720.332957:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1782480720.332995:0:5794:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1782480720.333015:0:5794:0:(mgs_llog.c:5244:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:1.0:1782480720.333018:0:5794:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:1.0:1782480720.333028:0:5794:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782480720.333048:0:5794:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333076:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c0030400/0x4776e02a9acf4efe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4ef7 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333084:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c0031200/0x4776e02a9acf4f28 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f21 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333090:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c0031a00/0x4776e02a9acf4f52 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f4b expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333097:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802059800/0x4776e02a9acf4f6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f67 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333104:0:5794:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802059000/0x4776e02a9acf4f98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f8a expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333112:0:5794:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333154:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802059000/0x4776e02a9acf4f98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4f8a expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333182:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d802059000/0x4776e02a9acf4f98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4f8a expref: 16 pid: 5797 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480720.333197:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388125824:0@lo:104: 00000100:00100000:1.0:1782480720.333268:0:5794:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782480720.333323:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802059800/0x4776e02a9acf4f6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4f67 expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333331:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d802059800/0x4776e02a9acf4f6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4f67 expref: 16 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480720.333345:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388125952:0@lo:104: 00010000:00010000:1.0:1782480720.333374:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c0031a00/0x4776e02a9acf4f52 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4f4b expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333381:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c0031a00/0x4776e02a9acf4f52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4f4b expref: 16 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480720.333389:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388126080:0@lo:104: 00010000:00010000:1.0:1782480720.333409:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c0031200/0x4776e02a9acf4f28 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4f21 expref: 16 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333417:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c0031200/0x4776e02a9acf4f28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4f21 expref: 16 pid: 5796 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480720.333423:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388126208:0@lo:104: 00010000:00010000:1.0:1782480720.333444:0:5794:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c0030400/0x4776e02a9acf4efe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4ef7 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.333451:0:5794:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c0030400/0x4776e02a9acf4efe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4ef7 expref: 16 pid: 5797 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480720.333458:0:5794:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388126336:0@lo:104: 00000100:00100000:1.0:1782480720.333473:0:5794:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480720.333542:0:5785:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782480720.333566:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.333595:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.333603:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.333611:0:5785:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.333621:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388125824 00000100:00100000:3.0:1782480720.333627:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388125824 00000100:00100000:3.0:1782480720.333693:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388125952 00000100:00100000:3.0:1782480720.333697:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388125952 00000100:00100000:3.0:1782480720.333711:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388126080 00000100:00100000:3.0:1782480720.333714:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388126080 00000100:00100000:3.0:1782480720.333723:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388126208 00000100:00100000:3.0:1782480720.333725:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388126208 00000100:00100000:3.0:1782480720.333734:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388126336 00000100:00100000:3.0:1782480720.333736:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388126336 00000100:00100000:3.0:1782480720.333748:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480720.333755:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c2cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+7:5794:x1869066388125824:12345-0@lo:104: 00010000:00010000:3.0:1782480720.333768:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.333832:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782480720.333839:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c2cdbc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+7:5794:x1869066388125824:12345-0@lo:104: Request processed in 84us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.333846:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480720.333886:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782480720.333892:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+6:5794:x1869066388125952:12345-0@lo:104: 00010000:00010000:3.0:1782480720.333899:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.333930:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782480720.333934:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+6:5794:x1869066388125952:12345-0@lo:104: Request processed in 43us (368us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.333945:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782480720.333957:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782480720.333963:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:5794:x1869066388126080:12345-0@lo:104: 00010000:00010000:3.0:1782480720.333970:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.333997:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1782480720.334001:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:5794:x1869066388126080:12345-0@lo:104: Request processed in 39us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.334006:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782480720.334016:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782480720.334021:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:5794:x1869066388126208:12345-0@lo:104: 00010000:00010000:3.0:1782480720.334028:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334049:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:3.0:1782480720.334054:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:5794:x1869066388126208:12345-0@lo:104: Request processed in 33us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.334059:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782480720.334068:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782480720.334073:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:5794:x1869066388126336:12345-0@lo:104: 00010000:00010000:3.0:1782480720.334080:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334103:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:3.0:1782480720.334108:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:5794:x1869066388126336:12345-0@lo:104: Request processed in 35us (496us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.334120:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1782480720.334139:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782480720.334145:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334152:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058a00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480720.334156:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334177:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480720.334185:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480720.334190:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480720.334219:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334226:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480720.334242:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334249:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d802058a00/0x4776e02a9acf4f8a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f98 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334263:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782480720.334266:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334283:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480720.334287:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334293:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480720.334298:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480720.334303:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480720.334319:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334324:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480720.334336:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334342:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d6c297a600/0x4776e02a9acf4f67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f6e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334350:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782480720.334352:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334357:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b800 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480720.334361:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334376:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480720.334381:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480720.334386:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480720.334398:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334403:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480720.334408:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334414:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf4f4b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f52 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334422:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782480720.334424:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334429:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c13a2400 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480720.334431:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334437:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480720.334442:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480720.334453:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480720.334466:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334471:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480720.334476:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334482:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf4f21 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f28 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334491:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480720.334493:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334498:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058c00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480720.334500:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334507:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480720.334512:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480720.334517:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480720.334528:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334534:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480720.334544:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334550:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4ef7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4efe expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334567:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480720.334569:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480720.334570:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480720.334593:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388126464:0@lo:103: 00000100:00100000:3.0:1782480720.334638:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.334684:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388126976:0@lo:103: 00000100:00100000:3.0:1782480720.334706:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.334728:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480720.334733:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388126848:0@lo:103: 00000100:00100000:3.0:1782480720.334751:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.334778:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388126464 00000100:00100000:3.0:1782480720.334782:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388126464 00010000:00010000:3.0:1782480720.334799:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802059000/0x4776e02a9acf4f98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f8a expref: 17 pid: 5797 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480720.334813:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388126976 00000100:00100000:3.0:1782480720.334816:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388126976 00010000:00010000:3.0:1782480720.334824:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c0030400/0x4776e02a9acf4efe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4ef7 expref: 18 pid: 5797 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480720.334832:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388126848 00000100:00100000:3.0:1782480720.334834:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388126848 00010000:00010000:3.0:1782480720.334841:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c0031200/0x4776e02a9acf4f28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f21 expref: 19 pid: 5796 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480720.334862:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480720.334868:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388126464:12345-0@lo:103: 00010000:00010000:3.0:1782480720.334879:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480720.334883:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802059000/0x4776e02a9acf4f98 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f8a expref: 19 pid: 5797 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334893:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802059000/0x4776e02a9acf4f98 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4f8a expref: 19 pid: 5797 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334908:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480720.334936:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388126464:12345-0@lo:103: Request processed in 68us (298us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.334942:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480720.334957:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782480720.334962:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3313:x1869066388126976:12345-0@lo:103: 00010000:00010000:3.0:1782480720.334970:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480720.334974:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c0030400/0x4776e02a9acf4efe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4ef7 expref: 18 pid: 5797 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334982:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c0030400/0x4776e02a9acf4efe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4ef7 expref: 18 pid: 5797 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.334991:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480720.335011:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3313:x1869066388126976:12345-0@lo:103: Request processed in 49us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.335017:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782480720.335028:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782480720.335041:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3313:x1869066388126848:12345-0@lo:103: 00010000:00010000:3.0:1782480720.335048:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480720.335053:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c0031200/0x4776e02a9acf4f28 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f21 expref: 17 pid: 5796 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.335061:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c0031200/0x4776e02a9acf4f28 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4f21 expref: 17 pid: 5796 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.335070:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480720.335091:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3313:x1869066388126848:12345-0@lo:103: Request processed in 52us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.335097:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782480720.335128:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388126848:0@lo:103: 00000100:00100000:3.0:1782480720.335135:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388126464:0@lo:103: 00000100:00100000:3.0:1782480720.335141:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388126976:0@lo:103: 00010000:00010000:2.0:1782480720.335240:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480720.335253:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388126592:0@lo:103: 00000100:00100000:2.0:1782480720.335283:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480720.335316:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480720.335322:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388126720:0@lo:103: 00000100:00100000:2.0:1782480720.335353:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480720.335373:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388126592 00000100:00100000:2.0:1782480720.335376:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388126592 00010000:00010000:2.0:1782480720.335393:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802059800/0x4776e02a9acf4f6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f67 expref: 17 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480720.335405:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388126720 00000100:00100000:2.0:1782480720.335407:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388126720 00010000:00010000:2.0:1782480720.335416:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c0031a00/0x4776e02a9acf4f52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f4b expref: 18 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480720.335426:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782480720.335430:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3310:x1869066388126592:12345-0@lo:103: 00010000:00010000:2.0:1782480720.335437:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480720.335441:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802059800/0x4776e02a9acf4f6e lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f67 expref: 18 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335448:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802059800/0x4776e02a9acf4f6e lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4f67 expref: 18 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335457:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480720.335483:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3310:x1869066388126592:12345-0@lo:103: Request processed in 52us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.335488:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782480720.335500:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782480720.335506:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3310:x1869066388126720:12345-0@lo:103: 00010000:00010000:2.0:1782480720.335513:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480720.335516:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c0031a00/0x4776e02a9acf4f52 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f4b expref: 17 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335535:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c0031a00/0x4776e02a9acf4f52 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4f4b expref: 17 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335546:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335554:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335569:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335575:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335581:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335587:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335592:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167ba00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782480720.335595:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335602:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335610:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335629:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480720.335653:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3310:x1869066388126720:12345-0@lo:103: Request processed in 147us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.335690:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782480720.335720:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388126720:0@lo:103: 00000100:00100000:2.0:1782480720.335727:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388126592:0@lo:103: 00010000:00010000:2.0:1782480720.335754:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802059000/0x4776e02a9acf4f98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4f8a expref: 16 pid: 5797 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480720.335765:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5c00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388125824:0@lo:104: 00010000:00010000:2.0:1782480720.335775:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802059800/0x4776e02a9acf4f6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4f67 expref: 15 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480720.335782:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388125952:0@lo:104: 00010000:00010000:2.0:1782480720.335791:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c0031a00/0x4776e02a9acf4f52 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4f4b expref: 14 pid: 5794 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480720.335801:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388126080:0@lo:104: 00010000:00010000:2.0:1782480720.335811:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c0031200/0x4776e02a9acf4f28 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4f21 expref: 13 pid: 5796 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480720.335819:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5500 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388126208:0@lo:104: 00010000:00010000:2.0:1782480720.335827:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c0030400/0x4776e02a9acf4efe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4ef7 expref: 12 pid: 5797 timeout: 400 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480720.335835:0:5794:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5794:1869066388126336:0@lo:104: 00010000:00010000:2.0:1782480720.335865:0:5794:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335874:0:5794:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335879:0:5794:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.335886:0:5794:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf4fad lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1782480720.335900:0:5794:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1782480720.404434:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:7499:x1869066388125696:12345-0@lo:253: Request processed in 89298us (89646us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.404451:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782480720.404541:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388125696:0@lo:253: 10000000:01000000:0.0:1782480720.404557:0:7499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1782480720.404560:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1782480720.404562:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1782480720.404563:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1782480720.404564:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:0.0:1782480720.404566:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1782480720.404567:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1782480720.404568:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1782480720.404584:0:7499:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1782480720.404585:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1782480720.404586:0:7499:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1782480720.404613:0:7499:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d6c29a2000 from lustre-OST0001 10000000:01000000:0.0:1782480720.404640:0:7499:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1782480720.404643:0:7499:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782480720.404652:0:7499:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91d7c2d04d40 local copy 10000000:01000000:0.0:1782480720.404655:0:7499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1782480720.404714:0:7499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.404725:0:7499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.404735:0:7499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480720.404755:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127104:0@lo:101: 00000100:00100000:0.0:1782480720.404791:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480720.404869:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8a11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782480720.404906:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388127104 00000100:00100000:2.0:1782480720.404913:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388127104 00000100:00100000:2.0:1782480720.404956:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782480720.404966:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+11:7499:x1869066388127104:12345-0@lo:101: 00010000:00010000:2.0:1782480720.404979:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480720.404993:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c13a3600/0x4776e02a9acf4fbb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4fb4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.405124:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c13a3600/0x4776e02a9acf4fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4fb4 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.405136:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c13a3600/0x4776e02a9acf4fbb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4fb4 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.405156:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c13a3600, rc 0) 00000100:00100000:2.0:1782480720.405242:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:7499:x1869066388127104:12345-0@lo:101: Request processed in 277us (450us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.405249:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782480720.405311:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127104:0@lo:101: 00010000:00010000:0.0:1782480720.405325:0:7499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.405334:0:7499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480720.405441:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127232:0@lo:501: 00000100:00100000:0.0:1782480720.405466:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480720.405525:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8a11e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782480720.405558:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388127232 00000100:00100000:2.0:1782480720.405563:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388127232 00000100:00100000:2.0:1782480720.405629:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1782480720.405636:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:7499:x1869066388127232:12345-0@lo:501: 00000100:00100000:2.0:1782480720.406101:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:7499:x1869066388127232:12345-0@lo:501: Request processed in 464us (632us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782480720.406109:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1782480720.406178:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127232:0@lo:501: 10000000:01000000:0.0:1782480720.406198:0:7499:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1782480720.406223:0:7499:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1782480720.406229:0:7499:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.406238:0:7499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.406244:0:7499:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.406313:0:7499:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1782480720.406337:0:7499:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d6c29a2000 10000000:01000000:0.0:1782480720.406342:0:7499:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1782480720.406347:0:7499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1782480720.406349:0:7499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1782480720.406354:0:7499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1782480720.406356:0:7499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1782480720.406378:0:7499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.406386:0:7499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.406395:0:7499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480720.406410:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127360:0@lo:101: 00000100:00100000:0.0:1782480720.406438:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480720.406478:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df46ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480720.406527:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388127360 00000100:00100000:2.0:1782480720.406532:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388127360 00000100:00100000:2.0:1782480720.406564:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782480720.406571:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:7499:x1869066388127360:12345-0@lo:101: 00010000:00010000:2.0:1782480720.406581:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480720.406590:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c13a2800/0x4776e02a9acf4fc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4fc2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.406607:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c13a2800/0x4776e02a9acf4fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4fc2 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.406616:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c13a2800/0x4776e02a9acf4fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4fc2 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.406623:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c13a2800, rc 0) 00000100:00100000:2.0:1782480720.406686:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388127360:12345-0@lo:101: Request processed in 115us (246us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.406700:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782480720.406788:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127360:0@lo:101: 00010000:00010000:0.0:1782480720.406800:0:7499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.406807:0:7499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480720.406870:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127488:0@lo:501: 00000100:00100000:0.0:1782480720.406894:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480720.406908:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df46ef00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480720.406952:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388127488 00000100:00100000:2.0:1782480720.406956:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388127488 00000100:00100000:2.0:1782480720.406986:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782480720.406992:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388127488:12345-0@lo:501: 00000100:00100000:2.0:1782480720.407184:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388127488:12345-0@lo:501: Request processed in 191us (287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.407190:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782480720.407223:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127488:0@lo:501: 00000100:00100000:2.0:1782480720.407254:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127616:0@lo:503: 00000100:00100000:2.0:1782480720.407292:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480720.407307:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c5749c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480720.407319:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388127616 00000100:00100000:2.0:1782480720.407323:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388127616 00000100:00100000:2.0:1782480720.407339:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782480720.407345:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388127616:12345-0@lo:503: 00000100:00100000:2.0:1782480720.407488:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388127616:12345-0@lo:503: Request processed in 142us (195us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.407494:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782480720.407532:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127616:0@lo:503: 00000040:00080000:2.0:1782480720.407848:0:7499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782480720.407908:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127744:0@lo:502: 00000100:00100000:2.0:1782480720.407943:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480720.407960:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c5749c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480720.407976:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388127744 00000100:00100000:2.0:1782480720.407984:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388127744 00000100:00100000:2.0:1782480720.408005:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782480720.408011:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388127744:12345-0@lo:502: 00000100:00100000:2.0:1782480720.408145:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388127744:12345-0@lo:502: Request processed in 134us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.408153:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782480720.408202:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127744:0@lo:502: 00000040:00080000:2.0:1782480720.408440:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1782480720.408485:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:2.0:1782480720.408522:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:2.0:1782480720.408571:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:2.0:1782480720.408608:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:2.0:1782480720.408644:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:2.0:1782480720.408692:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127872:0@lo:502: 00000100:00100000:2.0:1782480720.408730:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480720.408747:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c5749c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480720.408762:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388127872 00000100:00100000:2.0:1782480720.408766:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388127872 00000100:00100000:2.0:1782480720.408785:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782480720.408791:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388127872:12345-0@lo:502: 00000100:00100000:2.0:1782480720.408910:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388127872:12345-0@lo:502: Request processed in 119us (179us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.408916:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782480720.408957:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388127872:0@lo:502: 00000040:00080000:2.0:1782480720.409026:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:2.0:1782480720.409036:0:7499:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00010000:00010000:3.0:1782480720.411119:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480720.411134:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.411144:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480720.411148:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.411158:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480720.411175:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480720.411201:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480720.411252:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.411259:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782480720.411310:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00010000:00010000:3.0:1782480720.411331:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.411339:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf4fb4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x4776e02a9acf4fbb expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.411358:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480720.411360:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480720.411362:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1782480720.411496:0:7507:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782480720.411505:0:7507:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1782480720.411511:0:7507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480720.411513:0:7507:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1782480720.411520:0:7507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782480720.411536:0:7507:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91d7ed21b380) 00000020:00000080:3.0:1782480720.411559:0:7507:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1782480720.411566:0:7507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1782480720.411627:0:7507:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d6c29a2000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1782480720.411635:0:7507:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:3.0:1782480720.411642:0:7507:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4776e02a9acf4fd7 00000100:00100000:0.0:1782480720.414860:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388128000:0@lo:103: 00000100:00100000:0.0:1782480720.414938:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782480720.415984:0:7507:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1782480720.416415:0:7507:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000100:00100000:1.0:1782480720.417087:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388128000 00000100:00100000:1.0:1782480720.417098:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388128000 00000100:00100000:1.0:1782480720.417179:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480720.417190:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:3311:x1869066388128000:12345-0@lo:103: 00010000:00010000:1.0:1782480720.417221:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480720.417240:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a3600/0x4776e02a9acf4fbb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf4fb4 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.417256:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480720.417333:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:3311:x1869066388128000:12345-0@lo:103: Request processed in 145us (2395us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480720.417340:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480720.417742:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388128000:0@lo:103: 00000001:00000004:3.0:1782480720.419587:0:7507:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1782480720.420111:0:7507:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1782480720.425926:0:7507:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1782480720.426454:0:7507:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:1.0:1782480720.427719:0:7507:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:1.0:1782480720.427731:0:7507:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480720.427738:0:7507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480720.427740:0:7507:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:1.0:1782480720.427744:0:7507:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480720.427749:0:7507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480720.427750:0:7507:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782480720.427754:0:7507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782480720.427756:0:7507:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782480720.427805:0:7507:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480720.427808:0:7507:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480720.427809:0:7507:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:1.0:1782480720.427812:0:7507:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:3.0:1782480720.428288:0:7499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:3.0:1782480720.428321:0:7499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782480720.428347:0:7499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.428360:0:7499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480720.428368:0:7499:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d6c29a2000 from 1 10000000:01000000:3.0:1782480720.428371:0:7499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782480720.428406:0:7499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.428415:0:7499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.428427:0:7499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480720.428451:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128128:0@lo:101: 00000100:00100000:3.0:1782480720.428518:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.428559:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cf180 going to sleep for 11 seconds 00000100:00100000:3.0:1782480720.428581:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388128128 00000100:00100000:3.0:1782480720.428587:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388128128 00000100:00100000:3.0:1782480720.428626:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782480720.428634:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:7499:x1869066388128128:12345-0@lo:101: 00010000:00010000:3.0:1782480720.428647:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480720.428686:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4fe5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4fde expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.428722:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4fe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4fde expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.428732:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4fe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4fde expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.428741:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d802058a00, rc 0) 00000100:00100000:3.0:1782480720.428776:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388128128:12345-0@lo:101: Request processed in 143us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.428783:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782480720.428896:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128128:0@lo:101: 00010000:00010000:3.0:1782480720.428910:0:7499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.428919:0:7499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480720.429001:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128256:0@lo:501: 00000100:00100000:3.0:1782480720.429040:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.429053:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cf180 going to sleep for 11 seconds 00000100:00100000:0.0:1782480720.431057:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388128256 00000100:00100000:0.0:1782480720.431071:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388128256 00000100:00100000:0.0:1782480720.431123:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1782480720.431132:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388128256:12345-0@lo:501: 00000100:00100000:0.0:1782480720.431438:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388128256:12345-0@lo:501: Request processed in 306us (2395us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480720.431446:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782480720.431868:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128256:0@lo:501: 00000100:00100000:3.0:1782480720.431936:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128384:0@lo:503: 00000100:00100000:3.0:1782480720.431984:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.432123:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cf180 going to sleep for 11 seconds 00000100:00100000:0.0:1782480720.433759:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388128384 00000100:00100000:0.0:1782480720.433771:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388128384 00000100:00100000:0.0:1782480720.433859:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1782480720.433868:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388128384:12345-0@lo:503: 00000100:00100000:0.0:1782480720.435901:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388128384:12345-0@lo:503: Request processed in 2014us (3896us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480720.435916:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1782480720.436024:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128384:0@lo:503: 00000040:00080000:3.0:1782480720.436368:0:7499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782480720.436450:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128512:0@lo:502: 00000100:00100000:3.0:1782480720.436499:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.438728:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cf180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480720.438827:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388128512 00000100:00100000:1.0:1782480720.438836:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388128512 00000100:00100000:1.0:1782480720.438880:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782480720.438890:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388128512:12345-0@lo:502: 00000100:00100000:1.0:1782480720.440194:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388128512:12345-0@lo:502: Request processed in 1298us (3687us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480720.440204:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782480720.440352:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128512:0@lo:502: 00000040:00080000:3.0:1782480720.441810:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1782480720.441891:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1782480720.441940:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128640:0@lo:502: 00000100:00100000:3.0:1782480720.444323:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.444409:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cf180 going to sleep for 11 seconds 00000100:00100000:0.0:1782480720.444510:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388128640 00000100:00100000:0.0:1782480720.444519:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388128640 00000100:00100000:0.0:1782480720.444572:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782480720.444582:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388128640:12345-0@lo:502: 00000100:00100000:0.0:1782480720.445193:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388128640:12345-0@lo:502: Request processed in 610us (876us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480720.445202:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782480720.445287:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128640:0@lo:502: 00000040:00080000:3.0:1782480720.445432:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1782480720.445447:0:7499:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1782480720.446308:0:7511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480720.446328:0:7511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480720.446330:0:7511:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782480720.446339:0:7511:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d6c29a2000 00000020:00000080:2.0:1782480720.446341:0:7511:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782480720.446366:0:7511:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480720.446369:0:7511:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480720.446371:0:7511:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1782480720.446374:0:7511:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1782480720.446505:0:7499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1782480720.446522:0:7499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782480720.446563:0:7499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.446572:0:7499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480720.446606:0:7499:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782480720.446608:0:7499:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d6c29a2000 10000000:01000000:3.0:1782480720.446611:0:7499:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d6c29a2000 10000000:01000000:3.0:1782480720.446614:0:7499:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480720.446617:0:7499:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d6c29a2000 from 1 10000000:01000000:3.0:1782480720.446619:0:7499:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782480720.446646:0:7499:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.446685:0:7499:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.446693:0:7499:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480720.446712:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128768:0@lo:101: 00000100:00100000:3.0:1782480720.446757:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.446782:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480720.446825:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388128768 00000100:00100000:2.0:1782480720.446829:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388128768 00000100:00100000:2.0:1782480720.446861:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1782480720.446866:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388128768:12345-0@lo:101: 00010000:00010000:2.0:1782480720.446877:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480720.446887:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c13a2e00/0x4776e02a9acf4ff3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf4fec expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.446911:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c13a2e00/0x4776e02a9acf4ff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf4fec expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.446921:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c13a2e00/0x4776e02a9acf4ff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4fec expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480720.446929:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c13a2e00, rc 0) 00000100:00100000:2.0:1782480720.446975:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7499:x1869066388128768:12345-0@lo:101: Request processed in 107us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.446981:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782480720.447218:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128768:0@lo:101: 00010000:00010000:3.0:1782480720.447231:0:7499:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.447237:0:7499:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480720.447295:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128896:0@lo:501: 00000100:00100000:3.0:1782480720.447314:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.447335:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cff00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480720.447373:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388128896 00000100:00100000:0.0:1782480720.447377:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388128896 00000100:00100000:0.0:1782480720.447403:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782480720.447410:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7499:x1869066388128896:12345-0@lo:501: 00000100:00100000:0.0:1782480720.447642:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7499:x1869066388128896:12345-0@lo:501: Request processed in 233us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480720.447647:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782480720.447925:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388128896:0@lo:501: 00000100:00100000:3.0:1782480720.447955:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388129024:0@lo:503: 00000100:00100000:3.0:1782480720.447992:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.448061:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cff00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480720.448386:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388129024 00000100:00100000:0.0:1782480720.448391:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388129024 00000100:00100000:0.0:1782480720.448461:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782480720.448469:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7499:x1869066388129024:12345-0@lo:503: 00000100:00100000:0.0:1782480720.448643:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7499:x1869066388129024:12345-0@lo:503: Request processed in 175us (650us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480720.448650:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782480720.448781:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388129024:0@lo:503: 00000040:00080000:3.0:1782480720.449034:0:7499:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782480720.449479:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388129152:0@lo:502: 00000100:00100000:3.0:1782480720.449518:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.449894:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480720.449952:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388129152 00000100:00100000:2.0:1782480720.449959:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388129152 00000100:00100000:1.0:1782480720.450012:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:1.0:1782480720.450022:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7499:x1869066388129152:12345-0@lo:502: 00000100:00100000:1.0:1782480720.450255:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7499:x1869066388129152:12345-0@lo:502: Request processed in 234us (734us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480720.450263:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1782480720.450458:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388129152:0@lo:502: 00000040:00080000:3.0:1782480720.450767:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1782480720.450818:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1782480720.450853:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1782480720.450900:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1782480720.450953:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1782480720.451030:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1782480720.451071:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1782480720.451232:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1782480720.451283:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1782480720.451315:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1782480720.451348:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1782480720.451395:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1782480720.451418:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1782480720.451434:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1782480720.451458:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1782480720.451475:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1782480720.451491:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1782480720.451514:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1782480720.451531:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1782480720.451547:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1782480720.451588:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1782480720.451607:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1782480720.451623:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1782480720.451646:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1782480720.451689:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1782480720.451708:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1782480720.451732:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1782480720.451760:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:3.0:1782480720.451777:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1782480720.451801:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:3.0:1782480720.451819:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:3.0:1782480720.451836:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:3.0:1782480720.451852:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:3.0:1782480720.451875:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:3.0:1782480720.451892:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:3.0:1782480720.451921:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:3.0:1782480720.451970:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:3.0:1782480720.452077:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388129280:0@lo:502: 00000100:00100000:3.0:1782480720.452383:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.452456:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480720.452505:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388129280 00000100:00100000:2.0:1782480720.452512:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388129280 00000100:00100000:2.0:1782480720.452554:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1782480720.452570:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7499:x1869066388129280:12345-0@lo:502: 00000100:00100000:3.0:1782480720.453387:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7499:x1869066388129280:12345-0@lo:502: Request processed in 815us (1001us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.453396:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782480720.453511:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388129280:0@lo:502: 00000040:00080000:1.0:1782480720.453605:0:7499:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1782480720.453618:0:7499:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:3.0:1782480720.454381:0:7512:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1782480720.454396:0:7512:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91d7ed21cd40) 00000020:00000080:3.0:1782480720.454418:0:7512:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:3.0:1782480720.454631:0:7512:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d6c29a2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782480720.454635:0:7512:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d6c29a2000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1782480720.454638:0:7512:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d6c29a2000 3 00010000:00080000:3.0:1782480720.455170:0:7512:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d7ed06c800@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.158@tcp at head 00010000:00010000:3.0:1782480720.458379:0:7512:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:3.0:1782480720.458464:0:7512:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1782480720.458494:0:7512:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782480720.458502:0:7512:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4776e02a9acf5001 00000100:00080000:3.0:1782480720.458511:0:7512:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782480720.458516:0:7512:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91d7ed06c800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:3.0:1782480720.458547:0:7512:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7ef3b9c00 x1869066388129408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782480720.458578:0:7512:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1782480720.458643:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480720.458654:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388129536:0@lo:400: 00000100:00100000:3.0:1782480720.458736:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.458764:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388129664:0@lo:400: 00000100:00100000:3.0:1782480720.458778:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.458789:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480720.458792:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388129792:0@lo:400: 00000100:00100000:3.0:1782480720.458806:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.458827:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388129536 00000100:00100000:3.0:1782480720.458832:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388129536 00000100:00100000:3.0:1782480720.458859:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388129664 00000100:00100000:3.0:1782480720.458861:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388129664 00000100:00100000:3.0:1782480720.458889:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782480720.458897:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388129536:12345-0@lo:400: 00000100:00100000:3.0:1782480720.458946:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388129536:12345-0@lo:400: Request processed in 49us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.458953:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782480720.458967:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782480720.458973:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388129664:12345-0@lo:400: 00000100:00100000:3.0:1782480720.459016:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388129664:12345-0@lo:400: Request processed in 43us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.459022:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782480720.459050:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388129792 00000100:00100000:3.0:1782480720.459053:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388129792 00000100:00100000:3.0:1782480720.459078:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782480720.459090:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388129792:12345-0@lo:400: 00000100:00100000:1.0:1782480720.459273:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1869066388129408:0@lo:38: 00000100:00100000:1.0:1782480720.459309:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480720.459424:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388129408 00000100:00100000:2.0:1782480720.459428:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388129408 00000100:00100000:2.0:1782480720.459451:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782480720.459456:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1869066388129408:12345-0@lo:38: 00010000:00080000:2.0:1782480720.459476:0:5804:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 251 last 0 00000020:00000080:2.0:1782480720.459505:0:5804:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4776e02a9acf5008 00000004:00100000:2.0:1782480720.459520:0:5804:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1782480720.459547:0:5804:0:(import.c:65:import_set_state_nolock()) ffff91d7df57b000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480720.459579:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869066388129408:12345-0@lo:38: Request processed in 122us (271us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480720.459583:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782480720.459640:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ef3b9c00 x1869066388129408/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782480730 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480720.459647:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782480720.459653:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:1.0:1782480720.459679:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:1.0:1782480720.459683:0:3309:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782480720.459684:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7ed06c800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782480720.459688:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1869066388129408:0@lo:38: 00000100:00100000:3.0:1782480720.459914:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388129792:12345-0@lo:400: Request processed in 825us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.459921:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1782480720.459951:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ef3ba300 x1869066388129792/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480720.459961:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388129792:0@lo:400: 00010000:00080000:3.0:1782480720.459970:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ef3b8380 x1869066388129664/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480720.459978:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388129664:0@lo:400: 00010000:00080000:3.0:1782480720.460016:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ef3b9880 x1869066388129536/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480736 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480720.460024:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388129536:0@lo:400: 00000040:00080000:1.0:1782480720.463304:0:7512:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1782480720.463359:0:7499:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1782480720.463387:0:7499:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1782480720.463406:0:7499:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.463418:0:7499:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1782480720.463502:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1782480720.463504:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782480720.463506:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782480720.463507:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782480720.463509:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782480720.463510:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782480720.463512:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782480720.463513:0:7499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782480720.463514:0:7499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782480720.463516:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782480720.463518:0:7499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782480720.463522:0:7499:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1782480720.463524:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1782480720.463526:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1782480720.463527:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1782480720.463528:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1782480720.463529:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1782480720.463530:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1782480720.463531:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1782480720.463532:0:7499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1782480720.463533:0:7499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1782480720.463534:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1782480720.463535:0:7499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1782480720.463562:0:7499:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1782480720.463580:0:7499:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388129920:0@lo:253: 00000100:00100000:1.0:1782480720.463646:0:7499:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480720.463697:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388129920 00000100:00100000:1.0:1782480720.463705:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388129920 00000100:00100000:1.0:1782480720.463741:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782480720.463750:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7499:x1869066388129920:12345-0@lo:253: 20000000:01000000:1.0:1782480720.463790:0:5797:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1782480720.463805:0:5797:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1782480720.464252:0:7499:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d25edc00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480720.464619:0:7513:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7513:1869066388130048:0@lo:901: 00000100:00100000:0.0:1782480720.464686:0:7513:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480720.464717:0:5813:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388130048 00000100:00100000:0.0:1782480720.464721:0:5813:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388130048 00000100:00100000:0.0:1782480720.464757:0:5813:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480720.464764:0:5813:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7513:x1869066388130048:12345-0@lo:901: 00000100:00100000:0.0:1782480720.465076:0:5813:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7513:x1869066388130048:12345-0@lo:901: Request processed in 311us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480720.465084:0:5813:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1782480720.465228:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480720.465239:0:7513:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6764540 going to sleep for 11 seconds 00010000:00080000:0.0:1782480720.465261:0:7513:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7c30fed80 x1869066388130048/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1782480736 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480720.465274:0:7513:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7513:1869066388130048:0@lo:901: 20000000:01000000:1.0:1782480720.492999:0:5797:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1782480720.493040:0:5797:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1782480720.493063:0:5818:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1782480720.493067:0:5818:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1782480720.493090:0:5818:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.493216:0:5818:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c0030200/0x4776e02a9acf4f60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f59 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.493227:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.493268:0:5818:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c0030200/0x4776e02a9acf4f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4f59 expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480720.493283:0:5818:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c0030200/0x4776e02a9acf4f60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4f59 expref: 14 pid: 5794 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480720.493299:0:5818:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1869066388130176:0@lo:104: 00000100:00100000:1.0:1782480720.493369:0:5818:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480720.493403:0:5818:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6ba2480 going to sleep for 11 seconds 00000100:00100000:3.0:1782480720.493521:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388130176 00000100:00100000:3.0:1782480720.493528:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388130176 00000100:00100000:3.0:1782480720.493581:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782480720.493591:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:5818:x1869066388130176:12345-0@lo:104: 00010000:00010000:3.0:1782480720.493605:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.493682:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782480720.493688:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:5818:x1869066388130176:12345-0@lo:104: Request processed in 99us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480720.493695:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1782480720.493717:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480720.493730:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.493737:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167bc00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480720.493741:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.493750:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480720.493756:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480720.493762:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480720.493791:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.493798:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480720.493817:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.493823:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167bc00/0x4776e02a9acf4f59 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f60 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.493838:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480720.493839:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480720.493841:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480720.493858:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388130304:0@lo:103: 00000100:00100000:3.0:1782480720.493889:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480720.493933:0:5818:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4700 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5818:1869066388130176:0@lo:104: 00010000:00010000:3.0:1782480720.493959:0:5818:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480720.494293:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388130304 00000100:00100000:0.0:1782480720.494298:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388130304 00010000:00010000:0.0:1782480720.494321:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c0030200/0x4776e02a9acf4f60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f59 expref: 15 pid: 5794 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480720.494383:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782480720.494390:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d1301050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:3310:x1869066388130304:12345-0@lo:103: 00010000:00010000:0.0:1782480720.494401:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480720.494406:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c0030200/0x4776e02a9acf4f60 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f59 expref: 15 pid: 5794 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494415:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c0030200/0x4776e02a9acf4f60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4f59 expref: 15 pid: 5794 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494426:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c0030200/0x4776e02a9acf4f60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4f59 expref: 15 pid: 5794 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494439:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494447:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782480720.494467:0:5786:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001400532s 00010000:00010000:0.0:1782480720.494470:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494477:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494484:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494492:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494497:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480720.494500:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494507:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494525:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480720.494534:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480720.494579:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d1301050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:3310:x1869066388130304:12345-0@lo:103: Request processed in 188us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480720.494586:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782480720.494686:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388130304:0@lo:103: 00010000:00010000:3.0:1782480720.494755:0:5818:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.494763:0:5818:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480720.494770:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167b800/0x4776e02a9acf500f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5818 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480720.508559:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:7499:x1869066388129920:12345-0@lo:253: Request processed in 44798us (44901us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480720.508576:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1782480720.508807:0:7499:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7499:1869066388129920:0@lo:253: 10000000:01000000:2.0:1782480720.508828:0:7499:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782480720.508832:0:7499:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782480720.508834:0:7499:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782480720.508835:0:7499:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480720.508836:0:7499:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480720.508838:0:7499:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480720.508840:0:7499:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480720.508841:0:7499:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480720.508843:0:7499:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1782480720.508844:0:7499:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1782480720.508846:0:7499:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480720.508847:0:7499:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782480720.508865:0:7499:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782480720.514591:0:7499:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480720.514873:0:7499:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480720.515529:0:7499:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480720.515831:0:7499:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480720.516245:0:7499:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480720.516509:0:7499:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1782480720.518272:0:7499:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1782480720.776080:0:7499:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:1.0:1782480720.776089:0:7499:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:1.0:1782480720.776123:0:7499:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782480720.776198:0:7499:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782480720.776213:0:7499:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:1.0:1782480720.776233:0:7499:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1782480720.807091:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480721.822957:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480722.848104:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480723.871150:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480724.897478:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480725.410814:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388130432:0@lo:13: 00000100:00100000:3.0:1782480725.410889:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480725.410963:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388130432 00000100:00100000:3.0:1782480725.410972:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388130432 00000100:00100000:3.0:1782480725.411026:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782480725.411035:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388130432:12345-0@lo:13: 00002000:00000024:3.0:1782480725.411073:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480725.411132:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3ba300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388130432:12345-0@lo:13: Request processed in 98us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480725.411139:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1782480725.411159:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782480725.411188:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef3b8380 x1869066388130432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480741 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480725.411206:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388130432:0@lo:13: 00000100:00100000:3.0:1782480725.921191:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388130560:0@lo:400: 00000100:00100000:3.0:1782480725.921273:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480725.921319:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388131072:0@lo:400: 00000100:00100000:3.0:1782480725.921345:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480725.921368:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480725.921373:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388130688:0@lo:400: 00000100:00100000:3.0:1782480725.921391:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480725.921418:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388130816:0@lo:400: 00000100:00100000:3.0:1782480725.921442:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480725.921460:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480725.921465:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388130944:0@lo:400: 00000100:00100000:3.0:1782480725.921952:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480725.922018:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388130560 00000100:00100000:3.0:1782480725.922025:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388130560 00000100:00100000:3.0:1782480725.922092:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782480725.922102:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:3312:x1869066388130560:12345-0@lo:400: 00000100:00100000:3.0:1782480725.922164:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:3312:x1869066388130560:12345-0@lo:400: Request processed in 63us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480725.922172:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782480725.922208:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388131072 00000100:00100000:3.0:1782480725.922211:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388131072 00000100:00100000:3.0:1782480725.922431:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388130688 00000100:00100000:3.0:1782480725.922436:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388130688 00000100:00100000:3.0:1782480725.922451:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388130816 00000100:00100000:3.0:1782480725.922454:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388130816 00000100:00100000:3.0:1782480725.922469:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782480725.922475:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388131072:12345-0@lo:400: 00000100:00100000:3.0:1782480725.922601:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388131072:12345-0@lo:400: Request processed in 125us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480725.922609:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782480725.922623:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782480725.922629:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388130688:12345-0@lo:400: 00000100:00100000:3.0:1782480725.922656:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388130688:12345-0@lo:400: Request processed in 28us (1263us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480725.922685:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782480725.922697:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782480725.922703:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388130816:12345-0@lo:400: 00000100:00100000:3.0:1782480725.922737:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388130816:12345-0@lo:400: Request processed in 34us (1293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480725.922742:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782480725.922770:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388130944 00000100:00100000:3.0:1782480725.922773:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388130944 00000100:00100000:3.0:1782480725.922800:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782480725.922807:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388130944:12345-0@lo:400: 00000100:00100000:3.0:1782480725.923113:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388130944:12345-0@lo:400: Request processed in 306us (1161us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480725.923119:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1782480725.923137:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782480725.923176:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c67b6300 x1869066388130944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480725.923190:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388130944:0@lo:400: 00010000:00080000:3.0:1782480725.923202:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c67b5c00 x1869066388130816/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480725.923224:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388130816:0@lo:400: 00010000:00010000:0.0:1782480725.923394:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00080000:3.0:1782480725.926718:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c67b7100 x1869066388130688/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480725.926736:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388130688:0@lo:400: 00000100:00100000:3.0:1782480725.926750:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388130560:0@lo:400: 00010000:00080000:3.0:1782480725.926762:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c67b5880 x1869066388131072/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480741 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480725.926770:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388131072:0@lo:400: 00010000:00010000:3.0:1782480726.942935:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782480727.456062:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1782480727.456071:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d7c7ca2800 from 30 10000000:01000000:3.0:1782480727.456077:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782480727.456123:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.456135:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.456145:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480727.456169:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388131200:0@lo:101: 00000100:00100000:3.0:1782480727.456242:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.456291:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480727.459588:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388131200 00000100:00100000:1.0:1782480727.459605:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388131200 00000100:00100000:1.0:1782480727.459767:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782480727.459778:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388131200:12345-0@lo:101: 00010000:00010000:1.0:1782480727.459796:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480727.459815:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c167a400/0x4776e02a9acf501d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5016 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480727.459845:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167a400/0x4776e02a9acf501d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5016 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480727.459857:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c167a400/0x4776e02a9acf501d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5016 expref: 14 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480727.459867:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c167a400, rc 0) 00000100:00100000:1.0:1782480727.459948:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388131200:12345-0@lo:101: Request processed in 172us (3706us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480727.459956:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782480727.471702:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388131200:0@lo:101: 00010000:00010000:1.0:1782480727.471733:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480727.471745:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480727.471826:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388131328:0@lo:501: 00000100:00100000:1.0:1782480727.471886:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480727.471920:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c3190180 going to sleep for 11 seconds 00000100:00100000:2.0:1782480727.472300:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388131328 00000100:00100000:2.0:1782480727.472307:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388131328 00000100:00100000:2.0:1782480727.473157:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1782480727.473173:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388131328:12345-0@lo:501: 00000100:00100000:2.0:1782480727.473553:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388131328:12345-0@lo:501: Request processed in 384us (1666us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480727.473561:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1782480727.476355:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388131328:0@lo:501: 00000100:00100000:0.0:1782480727.476446:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388131456:0@lo:503: 00000100:00100000:0.0:1782480727.476522:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.481450:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.486104:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388131456 00000100:00100000:3.0:1782480727.486122:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388131456 00000100:00100000:3.0:1782480727.486189:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782480727.486199:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388131456:12345-0@lo:503: 00000100:00100000:3.0:1782480727.486611:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388131456:12345-0@lo:503: Request processed in 414us (10088us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.486620:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:3.0:1782480727.486716:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fe300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388131456:0@lo:503: 00000100:00100000:3.0:1782480727.487143:0:7839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7839:1869066388131584:0@lo:502: 00000100:00100000:3.0:1782480727.487189:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.487213:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388131584 00000100:00100000:3.0:1782480727.487217:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388131584 00000100:00100000:3.0:1782480727.487239:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782480727.487245:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7839:x1869066388131584:12345-0@lo:502: 00000100:00100000:3.0:1782480727.487524:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7839:x1869066388131584:12345-0@lo:502: Request processed in 278us (335us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.487531:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782480727.487562:0:7839:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f480 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.487576:0:7839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7839:1869066388131584:0@lo:502: 00000100:00100000:3.0:1782480727.487617:0:7839:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7839:1869066388131712:0@lo:502: 00000100:00100000:3.0:1782480727.487646:0:7839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.487684:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388131712 00000100:00100000:3.0:1782480727.487688:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388131712 00000100:00100000:3.0:1782480727.487704:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782480727.487710:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7839:x1869066388131712:12345-0@lo:502: 00000100:00100000:3.0:1782480727.487817:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:7839:x1869066388131712:12345-0@lo:502: Request processed in 107us (170us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.487833:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1782480727.487858:0:7839:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c50180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.487870:0:7839:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7839:1869066388131712:0@lo:502: 00000040:00080000:3.0:1782480727.487886:0:7839:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1782480727.487935:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1782480727.487954:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782480727.487962:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.493451:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480727.493467:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1782480727.493470:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1782480727.493473:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1782480727.493518:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.493527:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.493538:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480727.493563:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388131840:0@lo:101: 00000100:00100000:3.0:1782480727.493640:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.493701:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c50180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.493727:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388131840 00000100:00100000:3.0:1782480727.493733:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388131840 00000100:00100000:3.0:1782480727.493800:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782480727.493809:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388131840:12345-0@lo:101: 00010000:00010000:3.0:1782480727.493824:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480727.493837:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d802059000/0x4776e02a9acf502b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5024 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.493861:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d802059000/0x4776e02a9acf502b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5024 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.493872:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d802059000/0x4776e02a9acf502b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5024 expref: 15 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.497284:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d802059000, rc 0) 00000100:00100000:3.0:1782480727.497450:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388131840:12345-0@lo:101: Request processed in 3638us (3805us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.497460:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1782480727.497537:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388131840:0@lo:101: 00010000:00010000:3.0:1782480727.497562:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.497575:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480727.497653:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388131968:0@lo:501: 00000100:00100000:3.0:1782480727.497708:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.497734:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c50180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.497758:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388131968 00000100:00100000:3.0:1782480727.497762:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388131968 00000100:00100000:3.0:1782480727.497790:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1782480727.497803:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388131968:12345-0@lo:501: 00000100:00100000:3.0:1782480727.501953:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388131968:12345-0@lo:501: Request processed in 4142us (4237us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.501977:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1782480727.502153:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388131968:0@lo:501: 00000100:00100000:2.0:1782480727.502208:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388132096:0@lo:503: 00000100:00100000:2.0:1782480727.502254:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480727.502293:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d21a1e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.502397:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388132096 00000100:00100000:3.0:1782480727.502404:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388132096 00000100:00100000:3.0:1782480727.502445:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1782480727.502454:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388132096:12345-0@lo:503: 00000100:00100000:3.0:1782480727.503273:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388132096:12345-0@lo:503: Request processed in 817us (1016us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.503281:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1782480727.503412:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388132096:0@lo:503: 00000100:00100000:2.0:1782480727.518105:0:7840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7840:1869066388132224:0@lo:502: 00000100:00100000:2.0:1782480727.518191:0:7840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480727.518238:0:7840:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d21a1780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.518343:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388132224 00000100:00100000:3.0:1782480727.518351:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388132224 00000100:00100000:3.0:1782480727.518397:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782480727.518407:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:7840:x1869066388132224:12345-0@lo:502: 00000100:00100000:3.0:1782480727.518832:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:7840:x1869066388132224:12345-0@lo:502: Request processed in 424us (639us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.518840:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1782480727.525602:0:7840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7840:1869066388132224:0@lo:502: 00000020:01000000:2.0:1782480727.525649:0:7840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480727.525671:0:7840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480727.525674:0:7840:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782480727.525679:0:7840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782480727.525681:0:7840:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1782480727.525712:0:7840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7840:1869066388132352:0@lo:502: 00000100:00100000:2.0:1782480727.525783:0:7840:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480727.525851:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388132352 00000100:00100000:2.0:1782480727.525858:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388132352 00000100:00100000:2.0:1782480727.525900:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782480727.525909:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:7840:x1869066388132352:12345-0@lo:502: 00000100:00100000:2.0:1782480727.526145:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:7840:x1869066388132352:12345-0@lo:502: Request processed in 236us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480727.526152:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:2.0:1782480727.526199:0:7840:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d21a1780 going to sleep for 11 seconds 00000100:00100000:2.0:1782480727.526211:0:7840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7840:1869066388132352:0@lo:502: 00000020:01000000:2.0:1782480727.526231:0:7840:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480727.526234:0:7840:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480727.526236:0:7840:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:2.0:1782480727.526239:0:7840:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1782480727.530813:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1782480727.530852:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1782480727.530864:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480727.530877:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480727.530889:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1782480727.530891:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d7c52cd800 from 30 10000000:01000000:0.0:1782480727.530894:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1782480727.531116:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480727.531125:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480727.531136:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480727.531162:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388132480:0@lo:101: 00000100:00100000:0.0:1782480727.531236:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.531276:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480727.531304:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388132480 00000100:00100000:0.0:1782480727.531311:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388132480 00000100:00100000:0.0:1782480727.531365:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782480727.532131:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388132480:12345-0@lo:101: 00010000:00010000:0.0:1782480727.532157:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480727.532172:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf5039 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5032 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480727.532198:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf5039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5032 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480727.532209:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf5039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5032 expref: 16 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480727.532218:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a200, rc 0) 00000100:00100000:0.0:1782480727.532273:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388132480:12345-0@lo:101: Request processed in 900us (1037us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480727.532280:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782480727.532335:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388132480:0@lo:101: 00010000:00010000:0.0:1782480727.532350:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480727.532359:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480727.533253:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388132608:0@lo:501: 00000100:00100000:0.0:1782480727.533294:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.533324:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.533995:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388132608 00000100:00100000:3.0:1782480727.534003:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388132608 00000100:00100000:3.0:1782480727.534061:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:3.0:1782480727.534070:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388132608:12345-0@lo:501: 00000100:00100000:3.0:1782480727.534360:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388132608:12345-0@lo:501: Request processed in 290us (1064us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.534368:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1782480727.534474:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388132608:0@lo:501: 00000100:00100000:0.0:1782480727.534511:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388132736:0@lo:503: 00000100:00100000:0.0:1782480727.534551:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.534576:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480727.534590:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388132736 00000100:00100000:0.0:1782480727.534594:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388132736 00000100:00100000:0.0:1782480727.534620:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782480727.534627:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388132736:12345-0@lo:503: 00000100:00100000:0.0:1782480727.534782:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388132736:12345-0@lo:503: Request processed in 155us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480727.535449:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1782480727.535500:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388132736:0@lo:503: 00000100:00100000:0.0:1782480727.535767:0:7845:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7845:1869066388132864:0@lo:502: 00000100:00100000:0.0:1782480727.536482:0:7845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.536516:0:7845:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cf780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.536804:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388132864 00000100:00100000:3.0:1782480727.536811:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388132864 00000100:00100000:3.0:1782480727.536861:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782480727.536869:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:7845:x1869066388132864:12345-0@lo:502: 00000100:00100000:3.0:1782480727.545078:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:7845:x1869066388132864:12345-0@lo:502: Request processed in 8199us (8587us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.545095:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782480727.545188:0:7845:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7845:1869066388132864:0@lo:502: 00000100:00100000:3.0:1782480727.545262:0:7845:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7845:1869066388132992:0@lo:502: 00000100:00100000:3.0:1782480727.545379:0:7845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.545416:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388132992 00000100:00100000:3.0:1782480727.545422:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388132992 00000100:00100000:3.0:1782480727.545459:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782480727.545466:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:7845:x1869066388132992:12345-0@lo:502: 00000100:00100000:3.0:1782480727.545614:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:7845:x1869066388132992:12345-0@lo:502: Request processed in 146us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.545620:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782480727.545680:0:7845:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057cb40 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.545693:0:7845:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7845:1869066388132992:0@lo:502: 00000040:00080000:3.0:1782480727.545712:0:7845:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1782480727.545809:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1782480727.545833:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1782480727.545844:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480727.545855:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480727.545864:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1782480727.545867:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91d7c52cd800 from 5 10000000:01000000:0.0:1782480727.545870:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1782480727.545895:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480727.545903:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480727.546025:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480727.546056:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388133120:0@lo:101: 00000100:00100000:0.0:1782480727.546086:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.546107:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cf900 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.546174:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388133120 00000100:00100000:3.0:1782480727.546178:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388133120 00000100:00100000:3.0:1782480727.546246:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782480727.546254:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388133120:12345-0@lo:101: 00010000:00010000:3.0:1782480727.546264:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480727.546276:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf5047 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5040 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.546305:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf5047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5040 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.546389:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf5047 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5040 expref: 17 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.546397:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b000, rc 0) 00000100:00100000:3.0:1782480727.546431:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388133120:12345-0@lo:101: Request processed in 177us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.546437:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1782480727.548019:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388133120:0@lo:101: 00010000:00010000:2.0:1782480727.548054:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480727.548065:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480727.548128:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388133248:0@lo:256: 00000100:00100000:2.0:1782480727.548180:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480727.550776:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d21a1780 going to sleep for 11 seconds 00000100:00100000:0.0:1782480727.563103:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388133248 00000100:00100000:0.0:1782480727.563119:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388133248 00000100:00100000:0.0:1782480727.563186:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782480727.563197:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388133248:12345-0@lo:256: 20000000:01000000:0.0:1782480727.563224:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782480727.563249:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782480727.563252:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1782480727.563422:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388133248:12345-0@lo:256: Request processed in 226us (15240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480727.563429:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:3.0:1782480727.570779:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388133248:0@lo:256: 10000000:01000000:3.0:1782480727.570848:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782480727.570860:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.570872:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480727.570882:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:3.0:1782480727.570884:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:3.0:1782480727.570887:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782480727.570920:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.570928:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.570937:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480727.570963:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388133376:0@lo:101: 00000100:00100000:3.0:1782480727.571052:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.571093:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.571113:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388133376 00000100:00100000:3.0:1782480727.571119:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388133376 00000100:00100000:3.0:1782480727.571163:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782480727.571172:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388133376:12345-0@lo:101: 00010000:00010000:3.0:1782480727.571185:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480727.571195:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf5055 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf504e expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.571217:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf5055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf504e expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.571228:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf5055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf504e expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.571237:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b200, rc 0) 00000100:00100000:3.0:1782480727.571271:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388133376:12345-0@lo:101: Request processed in 100us (219us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.571277:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:3.0:1782480727.571330:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388133376:0@lo:101: 00010000:00010000:3.0:1782480727.571342:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.571350:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480727.571411:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388133504:0@lo:501: 00000100:00100000:3.0:1782480727.571435:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.571449:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.571460:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388133504 00000100:00100000:3.0:1782480727.571463:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388133504 00000100:00100000:3.0:1782480727.571480:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782480727.571486:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388133504:12345-0@lo:501: 00000100:00100000:3.0:1782480727.571758:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388133504:12345-0@lo:501: Request processed in 271us (321us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.571765:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:3.0:1782480727.571794:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388133504:0@lo:501: 00000100:00100000:3.0:1782480727.571819:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388133632:0@lo:503: 00000100:00100000:3.0:1782480727.571853:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.571867:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.571877:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388133632 00000100:00100000:3.0:1782480727.571880:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388133632 00000100:00100000:3.0:1782480727.571896:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782480727.571901:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388133632:12345-0@lo:503: 00000100:00100000:3.0:1782480727.572184:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388133632:12345-0@lo:503: Request processed in 280us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.572191:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1782480727.572226:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388133632:0@lo:503: 00000100:00100000:1.0:1782480727.573287:0:7848:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7848:1869066388133760:0@lo:502: 00000100:00100000:1.0:1782480727.573486:0:7848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480727.573522:0:7848:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c3190180 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.573560:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388133760 00000100:00100000:3.0:1782480727.573566:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388133760 00000100:00100000:3.0:1782480727.573611:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:3.0:1782480727.573619:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:7848:x1869066388133760:12345-0@lo:502: 00000100:00100000:3.0:1782480727.573923:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:7848:x1869066388133760:12345-0@lo:502: Request processed in 303us (436us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.573930:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1782480727.574112:0:7848:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7848:1869066388133760:0@lo:502: 00000020:01000000:1.0:1782480727.574139:0:7848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782480727.574146:0:7848:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782480727.574153:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480727.574155:0:7848:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1782480727.574159:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782480727.574163:0:7848:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:1.0:1782480727.574182:0:7848:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782480727.574184:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782480727.574197:0:7848:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91d7f4cc19c0) 00000020:00000080:1.0:1782480727.574219:0:7848:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1782480727.574224:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782480727.574299:0:7848:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1782480727.574306:0:7848:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:1.0:1782480727.574387:0:7848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf5063 00010000:00080000:1.0:1782480727.574420:0:7848:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d800641800@lustre-OST0001-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1782480727.574639:0:7848:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1782480727.574956:0:7848:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1782480727.576088:0:7848:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782480727.579865:0:7848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480727.580246:0:7848:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480727.580296:0:7848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1782480727.580439:0:7848:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:1.0:1782480727.581270:0:7850:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480727.581276:0:7850:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:0.0:1782480727.586610:0:7848:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1782480727.586627:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1782480727.586800:0:7848:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782480727.586938:0:7848:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4776e02a9acf506a 00000100:00080000:1.0:1782480727.586951:0:7848:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782480727.586957:0:7848:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d800641800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:1.0:1782480727.587210:0:7848:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7c67b6a00 x1869066388133888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782480727.587271:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388133888:0@lo:8: 00000100:00100000:3.0:1782480727.587431:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.587508:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388133888 00000100:00100000:0.0:1782480727.587516:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388133888 00000100:00100000:0.0:1782480727.587548:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480727.587555:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1869066388133888:12345-0@lo:8: 00010000:00080000:0.0:1782480727.587582:0:6607:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 258 last 0 00000020:00000080:0.0:1782480727.587604:0:6607:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4776e02a9acf5071 00002000:00100000:0.0:1782480727.587618:0:6607:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91d7ef6c6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113662 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782480727.587629:0:6607:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1782480727.587633:0:6607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1782480727.587795:0:6607:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782480727.587938:0:6607:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782480727.587980:0:6607:0:(import.c:65:import_set_state_nolock()) ffff91d7ef6c4000 : changing import state from RECOVER to FULL 00000100:00080000:1.0:1782480727.588393:0:7848:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1782480727.588467:0:7848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480727.588473:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480727.588475:0:7848:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782480727.588479:0:7848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480727.588483:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480727.588484:0:7848:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782480727.588487:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782480727.588489:0:7848:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:1.0:1782480727.588516:0:7848:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7848:1869066388134016:0@lo:502: 00000100:00100000:1.0:1782480727.588569:0:7848:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480727.588597:0:7848:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6764540 going to sleep for 11 seconds 00000100:00100000:0.0:1782480727.590687:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1869066388133888:12345-0@lo:8: Request processed in 3120us (3247us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480727.590701:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782480727.590806:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c67b6a00 x1869066388133888/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782480737 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480727.590819:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1782480727.590829:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1782480727.590838:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1782480727.590843:0:3309:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1782480727.590846:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d800641800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1782480727.590867:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1782480727.590874:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388133888:0@lo:8: 00000100:00100000:3.0:1782480727.590909:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388134016 00000100:00100000:3.0:1782480727.590916:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388134016 00000100:00100000:3.0:1782480727.590962:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000004:00080000:0.0:1782480727.591780:0:7850:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782480727.591942:0:7850:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 258153282247ns, next at 0ns, rc = 0 00000100:00100000:3.0:1782480727.593427:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:7848:x1869066388134016:12345-0@lo:502: 00000100:00100000:3.0:1782480727.593715:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:7848:x1869066388134016:12345-0@lo:502: Request processed in 303us (5145us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.593724:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:0.0:1782480727.593958:0:7848:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:7848:1869066388134016:0@lo:502: 00000020:01000000:0.0:1782480727.594118:0:7848:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480727.594126:0:7848:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480727.594128:0:7848:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:0.0:1782480727.594134:0:7848:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:3.0:1782480727.594395:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:3.0:1782480727.594416:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1782480727.594427:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.594444:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480727.594454:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1782480727.594456:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91d7c2d04d40 from 1 10000000:01000000:3.0:1782480727.594458:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782480727.594488:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.594495:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480727.594504:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480727.594521:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388134144:0@lo:101: 00000100:00100000:3.0:1782480727.594559:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.594590:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d258f600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480727.594780:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388134272:0@lo:400: 00000100:00100000:0.0:1782480727.594813:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.594835:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480727.594841:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388134656:0@lo:400: 00000100:00100000:0.0:1782480727.594861:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.594889:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388134400:0@lo:400: 00000100:00100000:0.0:1782480727.594911:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.594928:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480727.594933:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388134528:0@lo:400: 00000100:00100000:0.0:1782480727.594954:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.595177:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388134272 00000100:00100000:0.0:1782480727.595184:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388134272 00000100:00100000:0.0:1782480727.595274:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388134656 00000100:00100000:0.0:1782480727.595278:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388134656 00000100:00100000:3.0:1782480727.595682:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388134400 00000100:00100000:3.0:1782480727.595687:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388134400 00000100:00100000:3.0:1782480727.595712:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782480727.595719:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388134272:12345-0@lo:400: 00000100:00100000:3.0:1782480727.595775:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388134272:12345-0@lo:400: Request processed in 55us (960us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.595782:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782480727.595797:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782480727.595803:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388134656:12345-0@lo:400: 00000100:00100000:3.0:1782480727.595841:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388134656:12345-0@lo:400: Request processed in 38us (978us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.595847:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782480727.595859:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782480727.595866:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388134400:12345-0@lo:400: 00000100:00100000:3.0:1782480727.595896:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388134400:12345-0@lo:400: Request processed in 31us (985us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.595901:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782480727.596409:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388134528 00000100:00100000:0.0:1782480727.596415:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388134528 00000100:00100000:0.0:1782480727.596488:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480727.596497:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388134528:12345-0@lo:400: 00000100:00100000:0.0:1782480727.596532:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388134528:12345-0@lo:400: Request processed in 37us (1577us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480727.596537:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:0.0:1782480727.596600:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480727.596605:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1782480727.596785:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c30fca80 x1869066388134656/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480727.596801:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388134656:0@lo:400: 00010000:00080000:1.0:1782480727.596813:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c30fd180 x1869066388134272/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480727.596821:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388134272:0@lo:400: 00000100:00100000:2.0:1782480727.601120:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388134144 00000100:00100000:2.0:1782480727.601137:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388134144 00000100:00100000:2.0:1782480727.601193:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782480727.601202:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388134144:12345-0@lo:101: 00010000:00010000:2.0:1782480727.601220:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480727.601243:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf507f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5078 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480727.601270:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf507f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5078 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480727.601281:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf507f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5078 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480727.601290:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c13a2000, rc 0) 00000100:00100000:2.0:1782480727.601798:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388134144:12345-0@lo:101: Request processed in 173us (6814us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480727.601806:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782480727.601870:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388134144:0@lo:101: 00010000:00010000:2.0:1782480727.601888:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480727.601898:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480727.602340:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388134784:0@lo:501: 00000100:00100000:2.0:1782480727.602386:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480727.602419:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d21a1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480727.602435:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388134784 00000100:00100000:2.0:1782480727.602440:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388134784 00000100:00100000:2.0:1782480727.602466:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782480727.602474:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388134784:12345-0@lo:501: 00000100:00100000:2.0:1782480727.602740:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388134784:12345-0@lo:501: Request processed in 266us (353us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782480727.602756:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782480727.602803:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddf800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388134784:0@lo:501: 10000000:01000000:2.0:1782480727.602831:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1782480727.602839:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480727.602848:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00080000:0.0:1782480727.603793:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c30ffb80 x1869066388134528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480727.603810:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388134528:0@lo:400: 00010000:00080000:0.0:1782480727.603825:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c30fdf80 x1869066388134400/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480743 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480727.603833:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388134400:0@lo:400: 00000004:00080000:3.0:1782480727.671706:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000001:02000400:1.0:1782480727.716415:0:7863:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000004:00080000:2.0:1782480727.746767:0:7851:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:0.0:1782480727.746785:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480727.746818:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388134912:0@lo:13: 00000100:00100000:2.0:1782480727.746860:0:7851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4dde300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7851:1869066388135040:0@lo:7: 00000100:00100000:2.0:1782480727.747102:0:7851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480727.747162:0:7851:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67ab900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480727.747189:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388135040 00000100:00100000:2.0:1782480727.747196:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388135040 00000100:00100000:2.0:1782480727.747250:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1782480727.747259:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7851:x1869066388135040:12345-0@lo:7: 00000100:00080000:3.0:1782480727.749533:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480727.758818:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.758906:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388134912 00000100:00100000:3.0:1782480727.758930:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388134912 00000100:00100000:3.0:1782480727.759005:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782480727.759018:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1869066388134912:12345-0@lo:13: 00002000:00000024:3.0:1782480727.759070:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1782480727.759166:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1869066388134912:12345-0@lo:13: Request processed in 151us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480727.759173:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782480727.759311:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7f4ddf800 x1869066388134912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480743 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480727.759342:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388134912:0@lo:13: 00002000:00080000:2.0:1782480727.793813:0:6609:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1782480727.793826:0:6609:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1782480727.793964:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7851:x1869066388135040:12345-0@lo:7: Request processed in 46698us (46856us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480727.793976:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1782480727.794209:0:7851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7f4dde300 x1869066388135040/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1782480743 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480727.794229:0:7851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4dde300 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7851:1869066388135040:0@lo:7: 00000004:00080000:0.0:1782480727.794260:0:7851:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:0.0:1782480727.794314:0:7851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7851:1869066388135168:0@lo:5: 00000100:00100000:0.0:1782480727.794393:0:7851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480727.794447:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388135168 00000100:00100000:0.0:1782480727.794457:0:7851:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67946c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480727.794458:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388135168 00000100:00100000:2.0:1782480727.794518:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782480727.794528:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7851:x1869066388135168:12345-0@lo:5: 00002000:00080000:2.0:1782480727.794561:0:6608:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1782480727.794569:0:6608:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1782480727.794970:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7851:x1869066388135168:12345-0@lo:5: Request processed in 443us (576us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782480727.794977:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:0.0:1782480727.795245:0:7851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c30ffb80 x1869066388135168/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782480743 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480727.795264:0:7851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7851:1869066388135168:0@lo:5: 00000004:00080000:0.0:1782480727.795280:0:7851:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:0.0:1782480727.795318:0:7851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7851:1869066388135296:0@lo:700: 00000100:00100000:0.0:1782480727.795350:0:7851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480727.795378:0:7851:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67946c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480727.795494:0:6615:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388135296 00000100:00100000:3.0:1782480727.795505:0:6615:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388135296 00000100:00100000:3.0:1782480727.795571:0:6615:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480727.795580:0:6615:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7851:x1869066388135296:12345-0@lo:700: 00000100:00100000:3.0:1782480727.797067:0:6615:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6615:1869066388135424:0@lo:700: 00000100:00100000:3.0:1782480727.797150:0:6615:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480727.797200:0:6615:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c33cd000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480727.799227:0:5809:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388135424 00000100:00100000:2.0:1782480727.799245:0:5809:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388135424 00000100:00100000:2.0:1782480727.799320:0:5809:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782480727.799331:0:5809:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6615:x1869066388135424:12345-0@lo:700: 40000000:02000000:2.0:1782480727.951285:0:5809:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:1.0:1782480727.966750:0:5809:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6615:x1869066388135424:12345-0@lo:700: Request processed in 167411us (169592us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480727.966832:0:5809:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782480727.967257:0:6615:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef3b9180 x1869066388135424/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1782480743 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480727.967301:0:6615:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9180 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6615:1869066388135424:0@lo:700: 40000000:02000000:3.0:1782480727.967318:0:6615:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00010000:00010000:0.0:1782480727.985652:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782480728.101025:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1782480728.101061:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1782480728.101192:0:6615:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7851:x1869066388135296:12345-0@lo:700: Request processed in 305608us (305836us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480728.101204:0:6615:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1782480728.101338:0:7851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c30fd180 x1869066388135296/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1782480743 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480728.101351:0:7851:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:2.0:1782480728.101368:0:7851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7851:1869066388135296:0@lo:700: 00000004:02000040:3.0:1782480728.163075:0:7851:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:3.0:1782480728.166876:0:7851:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7851:1869066388135552:0@lo:5: 00000100:00100000:3.0:1782480728.166955:0:7851:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480728.167270:0:7851:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2cff00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480728.167362:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388135552 00000100:00100000:2.0:1782480728.167370:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388135552 00000100:00100000:2.0:1782480728.167432:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480728.167442:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7851:x1869066388135552:12345-0@lo:5: 00002000:00080000:0.0:1782480728.181047:0:6609:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1782480728.181068:0:6609:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1782480728.188711:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7851:x1869066388135552:12345-0@lo:5: Request processed in 21263us (21748us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1782480728.188725:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:2.0:1782480728.188740:0:7851:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef3b9180 x1869066388135552/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1782480744 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480728.188759:0:7851:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7851:1869066388135552:0@lo:5: 00000004:00080000:2.0:1782480728.188785:0:7851:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:3.0:1782480728.990941:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480730.016311:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480730.528814:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388135680:0@lo:13: 00000100:00100000:3.0:1782480730.528924:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480730.529799:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388135680 00000100:00100000:2.0:1782480730.529812:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388135680 00000100:00100000:2.0:1782480730.529913:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782480730.529925:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388135680:12345-0@lo:13: 00002000:00000024:2.0:1782480730.529974:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782480730.530013:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480730.530122:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388135680:12345-0@lo:13: Request processed in 198us (1196us total) trans 0 rc 0/0 00010000:00080000:0.0:1782480730.530735:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7f4ddd180 x1869066388135680/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480746 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480730.530763:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388135680:0@lo:13: 00000100:00100000:2.0:1782480730.530824:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:3.0:1782480731.039055:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480732.071844:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480733.092759:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480733.097570:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388136192:0@lo:400: 00000100:00100000:0.0:1782480733.097674:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480733.097738:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782480733.097745:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388135808:0@lo:400: 00000100:00100000:0.0:1782480733.097776:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480733.097800:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388136320:0@lo:400: 00000100:00100000:0.0:1782480733.097824:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480733.097851:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388135936:0@lo:400: 00000100:00100000:0.0:1782480733.097872:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480733.097887:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388136448:0@lo:400: 00000100:00100000:0.0:1782480733.097907:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480733.097924:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480733.097929:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388136064:0@lo:400: 00000100:00100000:0.0:1782480733.097962:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480733.097992:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388136320 00000100:00100000:0.0:1782480733.098011:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388136320 00000100:00100000:0.0:1782480733.098075:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388135936 00000100:00100000:0.0:1782480733.098079:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388135936 00000100:00100000:0.0:1782480733.098093:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388136064 00000100:00100000:0.0:1782480733.098096:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388136064 00000100:00100000:0.0:1782480733.098293:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782480733.098306:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388136320:12345-0@lo:400: 00000100:00100000:0.0:1782480733.098372:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388136320:12345-0@lo:400: Request processed in 69us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.098379:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782480733.098400:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782480733.098406:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388135936:12345-0@lo:400: 00000100:00100000:0.0:1782480733.098437:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388135936:12345-0@lo:400: Request processed in 32us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.098453:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782480733.098466:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782480733.098472:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388136064:12345-0@lo:400: 00000100:00100000:0.0:1782480733.098501:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388136064:12345-0@lo:400: Request processed in 29us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.098507:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782480733.098530:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388136192 00000100:00100000:0.0:1782480733.098534:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388136192 00000100:00100000:0.0:1782480733.098560:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388136448 00000100:00100000:0.0:1782480733.098563:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388136448 00000100:00100000:0.0:1782480733.098579:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782480733.098585:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388136192:12345-0@lo:400: 00000100:00100000:0.0:1782480733.098615:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388136192:12345-0@lo:400: Request processed in 30us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.098622:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782480733.098632:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782480733.098638:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388136448:12345-0@lo:400: 00000100:00100000:0.0:1782480733.098687:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388136448:12345-0@lo:400: Request processed in 49us (778us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.098693:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00080000:0.0:1782480733.098711:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480733.098715:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480733.098717:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782480733.098747:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4a6680 x1869066388136320/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480733.098760:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388136320:0@lo:400: 00010000:00080000:0.0:1782480733.098782:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4a6300 x1869066388136192/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480733.098791:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388136192:0@lo:400: 00010000:00080000:0.0:1782480733.098824:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4a4380 x1869066388136064/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480733.098832:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388136064:0@lo:400: 00010000:00080000:0.0:1782480733.098842:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c30ffb80 x1869066388135936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782480749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480733.098849:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388135936:0@lo:400: 00010000:00080000:0.0:1782480733.098857:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4a7800 x1869066388136448/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480749 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480733.098865:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388136448:0@lo:400: 00000100:00100000:0.0:1782480733.103846:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480733.103877:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388136576:0@lo:13: 00000100:00100000:2.0:1782480733.104320:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388135808 00000100:00100000:2.0:1782480733.104329:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388135808 00000100:00100000:0.0:1782480733.104503:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480733.104562:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388136576 00000100:00100000:0.0:1782480733.104566:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388136576 00000100:00100000:0.0:1782480733.104598:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782480733.104607:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388136576:12345-0@lo:13: 00002000:00000024:0.0:1782480733.104649:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480733.104728:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388136576:12345-0@lo:13: Request processed in 121us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.104736:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:0.0:1782480733.104779:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7f4ddc000 x1869066388136576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480749 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480733.105410:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388136576:0@lo:13: 00000100:00100000:0.0:1782480733.126004:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782480733.126027:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388135808:12345-0@lo:400: 00000100:00100000:0.0:1782480733.126384:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388135808:12345-0@lo:400: Request processed in 365us (28605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480733.126393:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782480733.126461:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388135808:0@lo:400: 00000001:00080000:0.0:1782480733.179415:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00010000:00010000:1.0:1782480734.112185:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480735.087421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480735.087522:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366091648 00000100:00100000:0.0:1782480735.087533:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366091648 00000100:00100000:0.0:1782480735.087596:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:0.0:1782480735.087605:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:0+-99:2349:x1869066366091648:12345-192.168.201.58@tcp:250: 00010000:00080000:0.0:1782480735.087635:0:5796:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from a3a65011-408e-4936-8eb0-c95e426cdd7c@192.168.201.58@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1782480735.087685:0:5796:0:(genops.c:1406:class_connect()) connect: client a3a65011-408e-4936-8eb0-c95e426cdd7c, cookie 0x4776e02a9acf5086 00000100:00080000:0.0:1782480735.088065:0:5796:0:(import.c:65:import_set_state_nolock()) ffff91d7ef6c1800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480735.088365:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+5:2349:x1869066366091648:12345-192.168.201.58@tcp:250: Request processed in 758us (955us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480735.088373:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:1.0:1782480735.104615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480735.105237:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366091520 00000100:00100000:2.0:1782480735.105258:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366091520 00000100:00100000:2.0:1782480735.105327:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:2.0:1782480735.105338:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+5:5555:x1869066366091520:12345-192.168.201.58@tcp:101: 00010000:00010000:2.0:1782480735.105358:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480735.105377:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf508d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fb34 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480735.105406:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf508d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb34 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480735.105416:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf508d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb34 expref: 6 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480735.105425:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c13a3200, rc 0) 00000100:00100000:2.0:1782480735.105493:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+6:5555:x1869066366091520:12345-192.168.201.58@tcp:101: Request processed in 156us (891us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480735.105499:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:1.0:1782480735.113463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480735.117486:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366091776 00000100:00100000:0.0:1782480735.117504:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366091776 00000100:00100000:0.0:1782480735.119717:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:0.0:1782480735.119741:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+6:5555:x1869066366091776:12345-192.168.201.58@tcp:501: 00000100:00100000:0.0:1782480735.120194:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+6:5555:x1869066366091776:12345-192.168.201.58@tcp:501: Request processed in 461us (6741us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782480735.120213:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:3.0:1782480735.126166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480735.126286:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366091904 00000100:00100000:0.0:1782480735.126299:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366091904 00000100:00100000:0.0:1782480735.126362:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:0.0:1782480735.126373:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+6:5555:x1869066366091904:12345-192.168.201.58@tcp:101: 00010000:00010000:0.0:1782480735.126390:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480735.126409:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf5094 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fb3b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480735.126439:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf5094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb3b expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480735.126451:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf5094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb3b expref: 7 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480735.126461:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297ba00, rc 0) 00000100:00100000:0.0:1782480735.126549:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+7:5555:x1869066366091904:12345-192.168.201.58@tcp:101: Request processed in 177us (393us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480735.126557:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 117 00010000:00010000:3.0:1782480735.134832:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480735.139011:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480735.140003:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366092032 00000100:00100000:0.0:1782480735.140018:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366092032 00000100:00100000:0.0:1782480735.140131:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:0.0:1782480735.140143:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+7:5555:x1869066366092032:12345-192.168.201.58@tcp:501: 00000100:00100000:0.0:1782480735.142646:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:5555:x1869066366092032:12345-192.168.201.58@tcp:501: Request processed in 2489us (3630us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480735.142744:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:2.0:1782480735.154400:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480735.156791:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366092160 00000100:00100000:1.0:1782480735.156807:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366092160 00000100:00100000:1.0:1782480735.156882:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:1.0:1782480735.156893:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:5555:x1869066366092160:12345-192.168.201.58@tcp:503: 00000100:00100000:1.0:1782480735.157330:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:5555:x1869066366092160:12345-192.168.201.58@tcp:503: Request processed in 436us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480735.157339:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:2.0:1782480735.163119:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480735.163228:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366092288 00000100:00100000:0.0:1782480735.163252:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366092288 00000100:00100000:0.0:1782480735.163316:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:0.0:1782480735.163327:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:5574:x1869066366092288:12345-192.168.201.58@tcp:502: 00000100:00100000:0.0:1782480735.163925:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:5574:x1869066366092288:12345-192.168.201.58@tcp:502: Request processed in 597us (816us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480735.163935:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:3.0:1782480735.210412:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480735.210607:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366092416 00000100:00100000:2.0:1782480735.210618:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366092416 00000100:00100000:2.0:1782480735.210731:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:2.0:1782480735.210741:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:5574:x1869066366092416:12345-192.168.201.58@tcp:502: 00000100:00100000:2.0:1782480735.211316:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:5574:x1869066366092416:12345-192.168.201.58@tcp:502: Request processed in 575us (913us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480735.211325:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:2.0:1782480735.218155:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480735.218634:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366092544 00000100:00100000:1.0:1782480735.218644:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366092544 00000100:00100000:1.0:1782480735.218745:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:1.0:1782480735.218755:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:5555:x1869066366092544:12345-192.168.201.58@tcp:101: 00010000:00010000:1.0:1782480735.218789:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480735.218808:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c167b000/0x4776e02a9acf509b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fb65 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480735.218838:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167b000/0x4776e02a9acf509b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb65 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480735.218849:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c167b000/0x4776e02a9acf509b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb65 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480735.218859:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c167b000, rc 0) 00000100:00100000:1.0:1782480735.218934:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5555:x1869066366092544:12345-192.168.201.58@tcp:101: Request processed in 180us (787us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480735.218941:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:0.0:1782480735.231528:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480735.231725:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366092672 00000100:00100000:2.0:1782480735.231737:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366092672 00000100:00100000:2.0:1782480735.231808:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:2.0:1782480735.231817:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5555:x1869066366092672:12345-192.168.201.58@tcp:256: 20000000:01000000:2.0:1782480735.231848:0:5794:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:2.0:1782480735.231884:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:2.0:1782480735.231889:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:2.0:1782480735.231892:0:5794:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:2.0:1782480735.231894:0:5794:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1782480735.236607:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5555:x1869066366092672:12345-192.168.201.58@tcp:256: Request processed in 4780us (5080us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480735.236622:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:3.0:1782480735.247631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480735.248930:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366092800 00000100:00100000:0.0:1782480735.248945:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366092800 00000100:00100000:0.0:1782480735.249017:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:0.0:1782480735.249027:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5555:x1869066366092800:12345-192.168.201.58@tcp:101: 00010000:00010000:0.0:1782480735.249046:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480735.249065:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297a800/0x4776e02a9acf50a2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fb6c expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480735.249093:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297a800/0x4776e02a9acf50a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb6c expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480735.249104:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297a800/0x4776e02a9acf50a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb6c expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480735.249113:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a800, rc 0) 00000100:00100000:0.0:1782480735.249184:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5555:x1869066366092800:12345-192.168.201.58@tcp:101: Request processed in 158us (1564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480735.249200:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:0.0:1782480735.257046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480735.257157:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366092928 00000100:00100000:2.0:1782480735.257168:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366092928 00000100:00100000:2.0:1782480735.257244:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:2.0:1782480735.257254:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5555:x1869066366092928:12345-192.168.201.58@tcp:501: 00000100:00100000:2.0:1782480735.258023:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5555:x1869066366092928:12345-192.168.201.58@tcp:501: Request processed in 765us (983us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480735.258033:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:3.0:1782480735.269026:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480735.271382:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366093056 00000100:00100000:1.0:1782480735.271397:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366093056 00000100:00100000:1.0:1782480735.271528:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:1.0:1782480735.271550:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5555:x1869066366093056:12345-192.168.201.58@tcp:503: 00000100:00100000:1.0:1782480735.272780:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5555:x1869066366093056:12345-192.168.201.58@tcp:503: Request processed in 1224us (3758us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480735.272791:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:3.0:1782480735.282423:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480735.282939:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366093184 00000100:00100000:2.0:1782480735.282950:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366093184 00000100:00100000:2.0:1782480735.283028:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00100000:2.0:1782480735.283039:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5578:x1869066366093184:12345-192.168.201.58@tcp:502: 00000100:00100000:2.0:1782480735.283352:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5578:x1869066366093184:12345-192.168.201.58@tcp:502: Request processed in 314us (938us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480735.283361:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00100000:2.0:1782480735.289323:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480735.289420:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366093312 00000100:00100000:1.0:1782480735.289430:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366093312 00000100:00100000:1.0:1782480735.289483:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 128 00000100:00100000:1.0:1782480735.289492:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5578:x1869066366093312:12345-192.168.201.58@tcp:502: 00000100:00100000:1.0:1782480735.289805:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5578:x1869066366093312:12345-192.168.201.58@tcp:502: Request processed in 314us (490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480735.289813:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 128 00000100:00100000:3.0:1782480735.294557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480735.295223:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366093440 00000100:00100000:0.0:1782480735.295235:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366093440 00000100:00100000:0.0:1782480735.295309:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:0.0:1782480735.295318:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2349:x1869066366093440:12345-192.168.201.58@tcp:38: 00010000:00080000:0.0:1782480735.295352:0:6840:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp t0 exp 0000000000000000 cur 265 last 0 00000020:00000080:0.0:1782480735.295406:0:6840:0:(genops.c:1406:class_connect()) connect: client 227f6c69-cfd7-4cc4-bae6-15b91431c78c, cookie 0x4776e02a9acf50a9 00000004:00100000:0.0:1782480735.295441:0:6840:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:0.0:1782480735.295446:0:6840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:3.0:1782480735.347430:0:6840:0:(import.c:65:import_set_state_nolock()) ffff91d7ed06d000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782480735.347565:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2349:x1869066366093440:12345-192.168.201.58@tcp:38: Request processed in 52245us (53019us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480735.347578:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:0.0:1782480735.647192:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388136704:0@lo:13: 00000100:00100000:0.0:1782480735.647290:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480735.647760:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388136704 00000100:00100000:2.0:1782480735.647769:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388136704 00000100:00100000:2.0:1782480735.649746:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782480735.649764:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388136704:12345-0@lo:13: 00002000:00000024:2.0:1782480735.649808:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480735.649915:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388136704:12345-0@lo:13: Request processed in 157us (2624us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480735.649923:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1782480735.649987:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7f4ddd500 x1869066388136704/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480751 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480735.650010:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388136704:0@lo:13: 00000100:00080000:0.0:1782480735.656821:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782480736.159110:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480736.357419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480736.357530:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480736.357724:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366093696 00000100:00100000:1.0:1782480736.357734:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366093696 00000100:00100000:1.0:1782480736.357794:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366093568 00000100:00100000:1.0:1782480736.357797:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366093568 00000100:00100000:1.0:1782480736.357825:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1782480736.357836:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:5555:x1869066366093696:12345-192.168.201.58@tcp:41: 00000004:00000024:1.0:1782480736.357891:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1782480736.357959:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:5555:x1869066366093696:12345-192.168.201.58@tcp:41: Request processed in 125us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480736.357966:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1782480736.357983:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1782480736.357989:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:0:x1869066366093568:12345-192.168.201.58@tcp:41: 00000004:00000024:1.0:1782480736.357999:0:5802:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:1.0:1782480736.358027:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:0:x1869066366093568:12345-192.168.201.58@tcp:41: Request processed in 38us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480736.358032:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00080000:0.0:1782480736.358443:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480736.361518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480736.361719:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366093824 00000100:00100000:1.0:1782480736.361730:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366093824 00000100:00100000:1.0:1782480736.361788:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1782480736.361799:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:5555:x1869066366093824:12345-192.168.201.58@tcp:40: 00000100:00100000:1.0:1782480736.361906:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:5555:x1869066366093824:12345-192.168.201.58@tcp:40: Request processed in 109us (399us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480736.361914:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:3.0:1782480736.368472:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480736.368519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480736.368720:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366093952 00000100:00100000:0.0:1782480736.368741:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366093952 00000100:00100000:0.0:1782480736.368779:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366094080 00000100:00100000:0.0:1782480736.368782:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366094080 00000100:00100000:0.0:1782480736.368795:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1782480736.368803:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1869066366093952:12345-192.168.201.58@tcp:8: 00010000:00080000:0.0:1782480736.368835:0:6607:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1782480736.368870:0:6607:0:(genops.c:1406:class_connect()) connect: client 227f6c69-cfd7-4cc4-bae6-15b91431c78c, cookie 0x4776e02a9acf50b0 00002000:00100000:0.0:1782480736.368880:0:6607:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 227f6c69-cfd7-4cc4-bae6-15b91431c78c/ffff91d7ef6c4800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782480736.368903:0:6607:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782480736.369261:0:6607:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782480736.369296:0:6607:0:(import.c:65:import_set_state_nolock()) ffff91d7ef6c2800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480736.369378:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2349:x1869066366093952:12345-192.168.201.58@tcp:8: Request processed in 573us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480736.369386:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1782480736.369407:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:0.0:1782480736.369426:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1869066366094080:12345-192.168.201.58@tcp:8: 00010000:00080000:0.0:1782480736.369442:0:6607:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp t0 exp 0000000000000000 cur 266 last 0 00000020:00000080:0.0:1782480736.369459:0:6607:0:(genops.c:1406:class_connect()) connect: client 227f6c69-cfd7-4cc4-bae6-15b91431c78c, cookie 0x4776e02a9acf50b7 00002000:00100000:0.0:1782480736.369465:0:6607:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 227f6c69-cfd7-4cc4-bae6-15b91431c78c/ffff91d7ef6c1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782480736.369480:0:6607:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782480736.372047:0:6607:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782480736.372097:0:6607:0:(import.c:65:import_set_state_nolock()) ffff91d7ef6c3800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480736.372655:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2349:x1869066366094080:12345-192.168.201.58@tcp:8: Request processed in 3224us (4132us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480736.372693:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:3.0:1782480736.377392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480736.377880:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366094208 00000100:00100000:0.0:1782480736.377901:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366094208 00000100:00100000:0.0:1782480736.377971:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:0.0:1782480736.377981:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2353:x1869066366094208:12345-192.168.201.58@tcp:400: 00000100:00100000:0.0:1782480736.378118:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2353:x1869066366094208:12345-192.168.201.58@tcp:400: Request processed in 139us (736us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480736.378127:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:3.0:1782480736.382876:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480736.383136:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366094336 00000100:00100000:1.0:1782480736.383145:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366094336 00000100:00100000:1.0:1782480736.383210:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1782480736.383220:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:5555:x1869066366094336:12345-192.168.201.58@tcp:33: 00000004:00080000:0.0:1782480736.415344:0:5805:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 31837us 00000004:00200000:1.0:1782480736.440937:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:1.0:1782480736.441547:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:5555:x1869066366094336:12345-192.168.201.58@tcp:33: Request processed in 58321us (58677us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480736.441560:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:2.0:1782480736.738377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480736.738485:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366094464 00000100:00100000:0.0:1782480736.738495:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366094464 00000100:00100000:0.0:1782480736.738558:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1782480736.738569:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:5595:x1869066366094464:12345-192.168.201.58@tcp:101: 00010000:00010000:0.0:1782480736.738590:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480736.738618:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ae00/0x4776e02a9acf50be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fb96 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480736.738751:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf50c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480736.738764:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf50c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480736.738777:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf50c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480736.739146:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782480736.739151:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480736.739232:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf50c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480736.739260:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ae00/0x4776e02a9acf50be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb96 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480736.739277:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf50c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb96 expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480736.739285:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480736.739288:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480736.739291:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782480736.739365:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:5595:x1869066366094464:12345-192.168.201.58@tcp:101: Request processed in 797us (997us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480736.739372:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00010000:00010000:3.0:1782480737.183226:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480738.206900:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480738.207446:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388136960:0@lo:400: 00000100:00100000:1.0:1782480738.207516:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480738.207545:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388137088:0@lo:400: 00000100:00100000:1.0:1782480738.207568:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388137472:0@lo:400: 00000100:00100000:3.0:1782480738.207571:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480738.207608:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480738.207615:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388136832:0@lo:400: 00000100:00100000:1.0:1782480738.207641:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388136960 00000100:00100000:3.0:1782480738.207642:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480738.207648:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388136960 00000100:00100000:3.0:1782480738.207681:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388137344:0@lo:400: 00000100:00100000:3.0:1782480738.207703:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480738.207719:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388137088 00000100:00100000:3.0:1782480738.207721:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480738.207723:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388137088 00000100:00100000:3.0:1782480738.207726:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388137216:0@lo:400: 00000100:00100000:3.0:1782480738.207746:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480738.207750:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388137344 00000100:00100000:1.0:1782480738.207752:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388137344 00000100:00100000:3.0:1782480738.207768:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388137472 00000100:00100000:1.0:1782480738.207768:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782480738.207771:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388137472 00000100:00100000:1.0:1782480738.207776:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388136960:12345-0@lo:400: 00000100:00100000:3.0:1782480738.207792:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388137216 00000100:00100000:3.0:1782480738.207794:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388137216 00000100:00100000:3.0:1782480738.207808:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782480738.207815:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388137472:12345-0@lo:400: 00000100:00100000:1.0:1782480738.207826:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388136960:12345-0@lo:400: Request processed in 50us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480738.207832:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782480738.207840:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388137472:12345-0@lo:400: Request processed in 27us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480738.207846:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782480738.207848:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782480738.207867:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388137088:12345-0@lo:400: 00000100:00100000:3.0:1782480738.207868:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782480738.207874:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388137216:12345-0@lo:400: 00000100:00100000:3.0:1782480738.207899:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388137216:12345-0@lo:400: Request processed in 25us (153us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480738.207899:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388137088:12345-0@lo:400: Request processed in 33us (327us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480738.207905:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1782480738.207911:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782480738.207916:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782480738.207922:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388137344:12345-0@lo:400: 00000100:00100000:1.0:1782480738.207945:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388137344:12345-0@lo:400: Request processed in 24us (241us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480738.207948:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388137088:0@lo:400: 00000100:00100000:1.0:1782480738.207950:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782480738.207975:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388136960:0@lo:400: 00010000:00080000:3.0:1782480738.207976:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b1180 x1869066388137216/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00010000:00080000:1.0:1782480738.207984:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5a8700 x1869066388137472/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480754 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480738.207987:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388137216:0@lo:400: 00000100:00100000:1.0:1782480738.207992:0:3312:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1782480738.207995:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388137344:0@lo:400: 00000100:00100000:1.0:1782480738.208002:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388137472:0@lo:400: 00000100:00080000:0.0:1782480738.208483:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480738.208487:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480738.208489:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480738.208616:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388136832 00000100:00100000:2.0:1782480738.208622:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388136832 00000100:00100000:0.0:1782480738.208640:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480738.208651:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388137600:0@lo:13: 00000100:00100000:2.0:1782480738.208653:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1782480738.208684:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388136832:12345-0@lo:400: 00000100:00100000:0.0:1782480738.208714:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480738.208724:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388136832:12345-0@lo:400: Request processed in 65us (1081us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480738.208730:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:0.0:1782480738.208759:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388136832:0@lo:400: 00000100:00100000:2.0:1782480738.208777:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388137600 00000100:00100000:2.0:1782480738.208780:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388137600 00000100:00100000:2.0:1782480738.208812:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782480738.208819:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388137600:12345-0@lo:13: 00002000:00000024:2.0:1782480738.208871:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480738.208906:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388137600:12345-0@lo:13: Request processed in 87us (191us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480738.208912:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:2.0:1782480738.208934:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7f4ddc700 x1869066388137600/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480754 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480738.208948:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388137600:0@lo:13: 00000100:00100000:0.0:1782480739.088281:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480739.088388:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366094592 00000100:00100000:3.0:1782480739.088402:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366094592 00000100:00100000:3.0:1782480739.088514:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:3.0:1782480739.088529:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:5648:x1869066366094592:12345-192.168.201.58@tcp:41: 00000004:00000024:3.0:1782480739.088593:0:6840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1782480739.088731:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:5648:x1869066366094592:12345-192.168.201.58@tcp:41: Request processed in 205us (462us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480739.088739:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00080000:0.0:1782480739.090310:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480739.091115:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480739.091275:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366094720 00000100:00100000:2.0:1782480739.091289:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366094720 00000100:00100000:2.0:1782480739.091389:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1782480739.091403:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:5648:x1869066366094720:12345-192.168.201.58@tcp:13: 00002000:00000024:2.0:1782480739.091453:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480739.091563:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:5648:x1869066366094720:12345-192.168.201.58@tcp:13: Request processed in 164us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480739.091572:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00080000:0.0:1782480739.091869:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480739.100448:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480739.100695:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366094848 00000100:00100000:0.0:1782480739.100708:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366094848 00000100:00100000:0.0:1782480739.100802:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:0.0:1782480739.100814:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:5648:x1869066366094848:12345-192.168.201.58@tcp:13: 00002000:00000024:0.0:1782480739.100861:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480739.100955:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:5648:x1869066366094848:12345-192.168.201.58@tcp:13: Request processed in 143us (522us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480739.100965:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00080000:2.0:1782480739.101336:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782480739.232259:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782480739.848963:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00010000:00010000:1.0:1782480740.263109:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480740.768697:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480740.768736:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388137728:0@lo:13: 00000100:00100000:1.0:1782480740.768825:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480740.768905:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388137728 00000100:00100000:1.0:1782480740.768915:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388137728 00000100:00100000:1.0:1782480740.768973:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480740.768983:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388137728:12345-0@lo:13: 00002000:00000024:1.0:1782480740.769018:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782480740.769133:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480740.769358:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388137728:12345-0@lo:13: Request processed in 375us (531us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480740.769366:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:1.0:1782480740.769406:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c67b7100 x1869066388137728/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480756 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480740.769424:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388137728:0@lo:13: 00000001:00100000:1.0:1782480740.890210:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000001:00100000:3.0:1782480740.895007:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00010000:00010000:3.0:1782480741.280560:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480741.867094:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480741.867142:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480741.867176:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480741.867202:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480741.867234:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366095360 00000100:00100000:2.0:1782480741.867245:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366095360 00000100:00100000:2.0:1782480741.867334:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366095232 00000100:00100000:2.0:1782480741.867339:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366095232 00000100:00100000:2.0:1782480741.867359:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1782480741.867369:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2351:x1869066366095360:12345-192.168.201.58@tcp:400: 00000100:00100000:2.0:1782480741.867463:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2351:x1869066366095360:12345-192.168.201.58@tcp:400: Request processed in 82us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480741.867470:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1782480741.867489:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782480741.867495:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2351:x1869066366095232:12345-192.168.201.58@tcp:400: 00000100:00100000:2.0:1782480741.867520:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2351:x1869066366095232:12345-192.168.201.58@tcp:400: Request processed in 25us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480741.867526:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782480741.867546:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366094976 00000100:00100000:2.0:1782480741.867549:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366094976 00000100:00100000:2.0:1782480741.867575:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:2.0:1782480741.867580:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2351:x1869066366094976:12345-192.168.201.58@tcp:400: 00000100:00100000:2.0:1782480741.867602:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2351:x1869066366094976:12345-192.168.201.58@tcp:400: Request processed in 23us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480741.867607:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00080000:2.0:1782480741.867636:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480741.867640:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480741.868316:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366095104 00000100:00100000:3.0:1782480741.868323:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366095104 00000100:00100000:3.0:1782480741.868369:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:3.0:1782480741.868376:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366095104:12345-192.168.201.58@tcp:400: 00000100:00100000:3.0:1782480741.868419:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366095104:12345-192.168.201.58@tcp:400: Request processed in 44us (1339us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480741.868439:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00080000:2.0:1782480741.868625:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782480742.312229:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480742.344266:0:8170:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1782480743.327108:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388137856:0@lo:13: 00000100:00100000:1.0:1782480743.327204:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782480743.327283:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480743.327309:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388137856 00000100:00100000:1.0:1782480743.327317:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388137856 00000100:00100000:1.0:1782480743.327390:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00080000:2.0:1782480743.327400:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480743.327402:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388137856:12345-0@lo:13: 00002000:00000024:1.0:1782480743.327440:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480743.327494:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388137856:12345-0@lo:13: Request processed in 95us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480743.327501:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:2.0:1782480743.327582:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7f4ddd880 x1869066388137856/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480759 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480743.327746:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388137984:0@lo:400: 00000100:00100000:3.0:1782480743.327796:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480743.327869:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388137984 00000100:00100000:1.0:1782480743.327884:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388137984 00000100:00100000:1.0:1782480743.327914:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782480743.327922:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388137984:12345-0@lo:400: 00000100:00100000:2.0:1782480743.327986:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388137856:0@lo:13: 00000100:00100000:2.0:1782480743.328026:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388138112:0@lo:400: 00000100:00100000:2.0:1782480743.329006:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480743.329168:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388138240:0@lo:400: 00000100:00100000:2.0:1782480743.329449:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480743.329457:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388138496:0@lo:400: 00000100:00100000:3.0:1782480743.333726:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388137984:0@lo:400: 00000100:00100000:3.0:1782480743.333822:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388138112 00000100:00100000:3.0:1782480743.333829:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388138112 00000100:00100000:3.0:1782480743.333884:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782480743.333891:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388138112:12345-0@lo:400: 00000100:00100000:0.0:1782480743.337348:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480743.337412:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480743.337424:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388138368:0@lo:400: 00000100:00100000:0.0:1782480743.338158:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480743.338205:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388138240 00000100:00100000:0.0:1782480743.338213:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388138240 00000100:00100000:0.0:1782480743.338264:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480743.338274:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388138240:12345-0@lo:400: 00000100:00100000:0.0:1782480743.338330:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388138240:12345-0@lo:400: Request processed in 58us (989us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480743.338351:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480743.338377:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388138368 00000100:00100000:0.0:1782480743.338381:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388138368 00000100:00100000:0.0:1782480743.338408:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782480743.338415:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388138368:12345-0@lo:400: 00000100:00100000:2.0:1782480743.339643:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480743.339746:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388138496 00000100:00100000:2.0:1782480743.339752:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388138496 00000100:00100000:2.0:1782480743.339798:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782480743.339806:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388138496:12345-0@lo:400: 00000100:00100000:2.0:1782480743.339854:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388138496:12345-0@lo:400: Request processed in 49us (213us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480743.339860:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1782480743.339879:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480743.339884:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480743.339925:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388138496:0@lo:400: 00000100:00100000:2.0:1782480743.339974:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388138240:0@lo:400: 00000100:00100000:0.0:1782480743.341282:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388138368:12345-0@lo:400: Request processed in 2859us (3116us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480743.341296:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1782480743.342793:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4a5500 x1869066388138368/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480759 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480743.342813:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388138368:0@lo:400: 00000100:00100000:1.0:1782480743.345780:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388137984:12345-0@lo:400: Request processed in 17835us (17959us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480743.345798:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1782480743.355963:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388138112:12345-0@lo:400: Request processed in 22060us (26946us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480743.355980:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782480743.356169:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388138112:0@lo:400: 00010000:00010000:0.0:1782480744.352300:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480745.376401:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480745.888689:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480745.888726:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388138624:0@lo:13: 00000100:00100000:3.0:1782480745.889024:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480745.889226:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388138624 00000100:00100000:1.0:1782480745.889233:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388138624 00000100:00100000:1.0:1782480745.889360:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782480745.889370:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388138624:12345-0@lo:13: 00002000:00000024:1.0:1782480745.889481:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480745.889528:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388138624:12345-0@lo:13: Request processed in 160us (505us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480745.889536:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:2.0:1782480745.889692:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782480745.890492:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4a4000 x1869066388138624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480761 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480745.890514:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388138624:0@lo:13: 00010000:00010000:1.0:1782480746.400740:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480746.989271:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480746.989340:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480746.989403:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480746.989436:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480746.996954:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366095616 00000100:00100000:2.0:1782480746.996977:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366095616 00000100:00100000:2.0:1782480746.997086:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:2.0:1782480746.997100:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366095616:12345-192.168.201.58@tcp:400: 00000100:00100000:0.0:1782480746.997109:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366095872 00000100:00100000:0.0:1782480746.997125:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366095872 00000100:00100000:0.0:1782480746.997197:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366095744 00000100:00100000:0.0:1782480746.997202:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366095744 00000100:00100000:2.0:1782480746.997224:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366095616:12345-192.168.201.58@tcp:400: Request processed in 124us (7962us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480746.997239:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:0.0:1782480746.997240:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1782480746.997257:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366095872:12345-192.168.201.58@tcp:400: 00000100:00080000:2.0:1782480746.997279:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480746.997286:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480746.997288:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480746.997349:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366095872:12345-192.168.201.58@tcp:400: Request processed in 94us (8006us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480746.997356:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1782480746.997381:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1782480746.997389:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366095744:12345-192.168.201.58@tcp:400: 00000100:00100000:0.0:1782480746.997415:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366095744:12345-192.168.201.58@tcp:400: Request processed in 29us (7979us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480746.997436:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1782480746.997481:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366095488 00000100:00100000:0.0:1782480746.997486:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366095488 00000100:00100000:0.0:1782480746.997533:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00100000:0.0:1782480746.997540:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2353:x1869066366095488:12345-192.168.201.58@tcp:400: 00000100:00100000:0.0:1782480746.997654:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2353:x1869066366095488:12345-192.168.201.58@tcp:400: Request processed in 113us (8250us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480746.997727:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 133 00000020:00000080:0.0:1782480747.206580:0:8318:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe04d78a30 20000000:00000080:0.0:1782480747.206603:0:8318:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d7efeb8c00 uarg=0000000000000000 20000000:01000000:0.0:1782480747.206655:0:8318:0:(mgs_llog.c:2004:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:0.0:1782480747.206689:0:8318:0:(mgs_llog.c:6054:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:0.0:1782480747.212103:0:8318:0:(mgs_llog.c:6085:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782480747.212115:0:8318:0:(mgs_llog.c:4738:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:0.0:1782480747.212122:0:8318:0:(mgs_llog.c:4172:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:0.0:1782480747.212151:0:8318:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1782480747.212156:0:8318:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1782480747.220447:0:8318:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:0.0:1782480747.220454:0:8318:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1782480747.224595:0:8319:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1782480747.225507:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1782480747.225565:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1782480747.225623:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1782480747.225638:0:8318:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1782480747.225641:0:8318:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1782480747.227644:0:8320:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:0.0:1782480747.228803:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:0.0:1782480747.229200:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:0.0:1782480747.229243:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:0.0:1782480747.229257:0:8318:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1782480747.229259:0:8318:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782480747.233052:0:8321:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:1.0:1782480747.234811:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:1.0:1782480747.234886:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:1.0:1782480747.234927:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:1.0:1782480747.234941:0:8318:0:(mgs_llog.c:2541:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1782480747.234944:0:8318:0:(mgs_llog.c:1106:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1782480747.238186:0:8322:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1782480747.238839:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1782480747.238895:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1782480747.238933:0:8318:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1782480747.238952:0:8318:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1782480747.238973:0:8318:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239003:0:8318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c13a2800/0x4776e02a9acf4fc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4fc2 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239011:0:8318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c13a2e00/0x4776e02a9acf4ff3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4fec expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239019:0:8318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c167a400/0x4776e02a9acf501d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5016 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239026:0:8318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802059000/0x4776e02a9acf502b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5024 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239032:0:8318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf5039 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5032 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239040:0:8318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf5055 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf504e expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239046:0:8318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf507f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5078 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239055:0:8318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf508d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb34 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239063:0:8318:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf5094 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb3b expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239072:0:8318:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239121:0:8318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf5094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb3b expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239137:0:8318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf5094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb3b expref: 9 pid: 5794 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480747.239153:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388138752:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480747.239532:0:8318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf508d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb34 expref: 9 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239542:0:8318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf508d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb34 expref: 9 pid: 5797 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480747.239551:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388138880:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480747.239605:0:8318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf507f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf5078 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239614:0:8318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf507f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf5078 expref: 18 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480747.239623:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139008:0@lo:104: 00000100:00100000:1.0:1782480747.239699:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782480747.239731:0:8318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf5055 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf504e expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239740:0:8318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf5055 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf504e expref: 18 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480747.239761:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139136:0@lo:104: 00000100:00100000:1.0:1782480747.239788:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480747.239822:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:1.0:1782480747.239829:0:8318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf5039 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf5032 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239839:0:8318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf5039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf5032 expref: 18 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480747.239839:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388139008 00000100:00100000:0.0:1782480747.239848:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388139008 00000100:00100000:1.0:1782480747.239852:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139264:0@lo:104: 00000100:00100000:1.0:1782480747.239891:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480747.239902:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388139136 00000100:00100000:0.0:1782480747.239914:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388139136 00010000:00010000:1.0:1782480747.239918:0:8318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802059000/0x4776e02a9acf502b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf5024 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.239928:0:8318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d802059000/0x4776e02a9acf502b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf5024 expref: 18 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480747.239937:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139392:0@lo:104: 00000100:00100000:0.0:1782480747.239945:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388139264 00000100:00100000:0.0:1782480747.239949:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388139264 00000100:00100000:1.0:1782480747.239962:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480747.239967:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388139392 00000100:00100000:0.0:1782480747.239971:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388139392 00010000:00010000:1.0:1782480747.239983:0:8318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c167a400/0x4776e02a9acf501d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf5016 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480747.239991:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1782480747.239998:0:8318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c167a400/0x4776e02a9acf501d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf5016 expref: 18 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480747.240009:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139520:0@lo:104: 00000100:00100000:0.0:1782480747.240016:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+6:8318:x1869066388139008:12345-0@lo:104: 00010000:00010000:0.0:1782480747.240030:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480747.240034:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782480747.240054:0:8318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c13a2e00/0x4776e02a9acf4ff3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4fec expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.240075:0:8318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c13a2e00/0x4776e02a9acf4ff3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4fec expref: 18 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480747.240084:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139648:0@lo:104: 00010000:00010000:0.0:1782480747.240102:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1782480747.240108:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480747.240112:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+6:8318:x1869066388139008:12345-0@lo:104: Request processed in 98us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480747.240120:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00010000:1.0:1782480747.240128:0:8318:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c13a2800/0x4776e02a9acf4fc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4fc2 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480747.240138:0:8318:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c13a2800/0x4776e02a9acf4fc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4fc2 expref: 18 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480747.240139:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388139520 00000100:00100000:0.0:1782480747.240145:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388139520 00000100:00100000:1.0:1782480747.240152:0:8318:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139776:0@lo:104: 00000100:00100000:0.0:1782480747.240161:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388139648 00000100:00100000:0.0:1782480747.240164:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388139648 00000100:00100000:1.0:1782480747.240176:0:8318:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480747.240182:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782480747.240188:0:8318:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2bacc0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480747.240189:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+7:8318:x1869066388139136:12345-0@lo:104: 00010000:00010000:0.0:1782480747.240199:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480747.240212:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b4700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139008:0@lo:104: 00010000:00010000:2.0:1782480747.240264:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480747.240271:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.240278:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:2.0:1782480747.240282:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.240290:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480747.240298:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480747.240304:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1782480747.240342:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.240349:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480747.240368:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.240381:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf5078 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf507f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.240395:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480747.240396:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480747.240398:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480747.240411:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388139904:0@lo:103: 00000100:00100000:2.0:1782480747.240441:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480747.240480:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388139904 00000100:00100000:2.0:1782480747.240484:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388139904 00010000:00010000:2.0:1782480747.240504:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf507f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5078 expref: 19 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.240527:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1782480747.240533:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388139904:12345-0@lo:103: 00010000:00010000:2.0:1782480747.240545:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480747.240550:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf507f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5078 expref: 19 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.240560:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf507f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf5078 expref: 19 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.240574:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf507f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf5078 expref: 19 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480747.240577:0:5785:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 2 min 2 max 56 00000100:00100000:3.0:1782480747.240587:0:5785:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_002' 00010000:00010000:2.0:1782480747.240588:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480747.240633:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dde300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3310:x1869066388139904:12345-0@lo:103: Request processed in 99us (190us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480747.240649:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782480747.240741:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388139904:0@lo:103: 00010000:00010000:0.0:1782480747.242223:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782480747.242239:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3a9050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+7:8318:x1869066388139136:12345-0@lo:104: Request processed in 2046us (2446us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480747.242250:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782480747.242298:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388139776 00000100:00100000:0.0:1782480747.242306:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388139776 00000100:00100000:0.0:1782480747.242331:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782480747.242349:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+7:8318:x1869066388139264:12345-0@lo:104: 00010000:00010000:0.0:1782480747.242363:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.242423:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782480747.242428:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+7:8318:x1869066388139264:12345-0@lo:104: Request processed in 81us (2538us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480747.242434:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782480747.242446:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480747.242451:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+6:8318:x1869066388139392:12345-0@lo:104: 00010000:00010000:0.0:1782480747.242458:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.242487:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782480747.242491:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6cb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+6:8318:x1869066388139392:12345-0@lo:104: Request processed in 41us (2532us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480747.242499:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480747.242512:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782480747.242520:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:8318:x1869066388139520:12345-0@lo:104: 00010000:00010000:3.0:1782480747.242521:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782480747.242528:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242530:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242549:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480747.242561:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.242567:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00010000:00010000:3.0:1782480747.242572:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480747.242574:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:8318:x1869066388139520:12345-0@lo:104: Request processed in 56us (2542us total) trans 0 rc 0/0 10000000:00010000:3.0:1782480747.242590:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480747.242591:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 10000000:01000000:3.0:1782480747.242600:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:0.0:1782480747.242607:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782480747.242624:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:8318:x1869066388139648:12345-0@lo:104: 00010000:00010000:3.0:1782480747.242630:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.242633:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242641:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480747.242706:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:0.0:1782480747.242712:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:8318:x1869066388139648:12345-0@lo:104: Request processed in 91us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480747.242717:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782480747.242731:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782480747.242738:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:8318:x1869066388139776:12345-0@lo:104: 00010000:00010000:0.0:1782480747.242745:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.242774:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:0.0:1782480747.242779:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6cb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:8318:x1869066388139776:12345-0@lo:104: Request processed in 43us (2605us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480747.242785:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:3.0:1782480747.242838:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242847:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c779a200/0x4776e02a9acf504e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf5055 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242859:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:3.0:1782480747.242862:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242868:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b200 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480747.242872:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.242878:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:3.0:1782480747.242880:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480747.242899:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480747.242904:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480747.242921:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242926:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480747.242942:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242948:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d6c297b200/0x4776e02a9acf5032 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf5039 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242961:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782480747.242964:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242971:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059c00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480747.242974:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.242981:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480747.242989:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480747.242995:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480747.243016:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.243023:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480747.243029:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.243036:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf5016 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf501d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.243048:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782480747.243051:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.243056:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059400 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480747.243060:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.243062:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388140288:0@lo:103: 00010000:00010000:3.0:1782480747.243075:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480747.243082:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480747.243088:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480747.243100:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.243106:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480747.243112:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.243116:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782480747.243134:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d802059400/0x4776e02a9acf4fec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4ff3 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.243146:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480747.243150:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.243157:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480747.243160:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.243164:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00010000:00010000:3.0:1782480747.243169:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.243174:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388140160:0@lo:103: 10000000:00010000:3.0:1782480747.243182:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480747.243188:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:2.0:1782480747.243204:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782480747.243206:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.243213:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480747.243218:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.243226:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d6c297be00/0x4776e02a9acf4fc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4fc9 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.243233:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388140032:0@lo:103: 00010000:00010000:3.0:1782480747.243236:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480747.243245:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480747.243248:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480747.243261:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480747.243274:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388140544:0@lo:103: 00000100:00100000:2.0:1782480747.243317:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480747.243336:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480747.243343:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388140416:0@lo:103: 00000100:00100000:2.0:1782480747.243365:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480747.243385:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388140288 00000100:00100000:2.0:1782480747.243389:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388140288 00010000:00010000:2.0:1782480747.243409:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c167a400/0x4776e02a9acf501d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5016 expref: 18 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.243422:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388140160 00000100:00100000:2.0:1782480747.243425:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388140160 00010000:00010000:2.0:1782480747.243436:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf5039 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5032 expref: 19 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.243446:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388140032 00000100:00100000:2.0:1782480747.243448:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388140032 00010000:00010000:2.0:1782480747.243458:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf5055 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf504e expref: 20 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.243482:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388140544 00000100:00100000:2.0:1782480747.243485:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388140544 00010000:00010000:2.0:1782480747.243497:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c13a2800/0x4776e02a9acf4fc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4fc2 expref: 21 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.243506:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388140416 00000100:00100000:2.0:1782480747.243509:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388140416 00010000:00010000:2.0:1782480747.243517:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c13a2e00/0x4776e02a9acf4ff3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4fec expref: 22 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.243528:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782480747.243534:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+22:3313:x1869066388140288:12345-0@lo:103: 00010000:00010000:2.0:1782480747.243544:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480747.243549:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c167a400/0x4776e02a9acf501d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5016 expref: 22 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.243558:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c167a400/0x4776e02a9acf501d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf5016 expref: 22 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.243575:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480747.243610:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+22:3313:x1869066388140288:12345-0@lo:103: Request processed in 76us (497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480747.243616:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782480747.243630:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782480747.243637:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+21:3313:x1869066388140160:12345-0@lo:103: 00010000:00010000:2.0:1782480747.243644:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480747.243648:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf5039 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5032 expref: 21 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.243704:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf5039 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf5032 expref: 21 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.243713:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480747.243736:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+21:3313:x1869066388140160:12345-0@lo:103: Request processed in 100us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480747.243742:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1782480747.243754:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782480747.243759:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+20:3311:x1869066388140032:12345-0@lo:103: 00010000:00010000:2.0:1782480747.243767:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480747.243771:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf5055 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf504e expref: 20 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.243778:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf5055 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf504e expref: 20 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.243788:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480747.243814:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+20:3311:x1869066388140032:12345-0@lo:103: Request processed in 55us (553us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480747.243819:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782480747.243831:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782480747.243837:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388140544:12345-0@lo:103: 00010000:00010000:2.0:1782480747.243844:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480747.243848:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c13a2800/0x4776e02a9acf4fc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4fc2 expref: 19 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.243854:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c13a2800/0x4776e02a9acf4fc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4fc2 expref: 19 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.243869:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480747.243892:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388140544:12345-0@lo:103: Request processed in 55us (587us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480747.243898:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782480747.243910:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782480747.243916:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3311:x1869066388140416:12345-0@lo:103: 00010000:00010000:2.0:1782480747.243923:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480747.243927:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c13a2e00/0x4776e02a9acf4ff3 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4fec expref: 18 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.243935:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c13a2e00/0x4776e02a9acf4ff3 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4fec expref: 18 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.243944:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480747.243962:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3311:x1869066388140416:12345-0@lo:103: Request processed in 47us (597us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480747.243968:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782480747.244002:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388140416:0@lo:103: 00000100:00100000:2.0:1782480747.244009:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388140032:0@lo:103: 00000100:00100000:2.0:1782480747.244014:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388140544:0@lo:103: 00000100:00100000:2.0:1782480747.244057:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388138752:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480747.244068:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf5055 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf504e expref: 17 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.244078:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139136:0@lo:104: 00010000:00010000:2.0:1782480747.244095:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf5039 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf5032 expref: 16 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.244104:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139264:0@lo:104: 00000100:00100000:2.0:1782480747.244113:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6cb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139392:0@lo:104: 00010000:00010000:2.0:1782480747.244120:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167a400/0x4776e02a9acf501d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf5016 expref: 15 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.244127:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139520:0@lo:104: 00010000:00010000:2.0:1782480747.244135:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a2e00/0x4776e02a9acf4ff3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4fec expref: 14 pid: 5797 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.244143:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139648:0@lo:104: 00010000:00010000:2.0:1782480747.244150:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a2800/0x4776e02a9acf4fc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4fc2 expref: 13 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480747.244157:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6ca680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388139776:0@lo:104: 00010000:00010000:2.0:1782480747.245460:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480747.245549:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480747.245552:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480747.245581:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.245592:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059800 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480747.245596:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.245605:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480747.245613:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480747.245792:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00000100:00100000:3.0:1782480747.246001:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388140160:0@lo:103: 00000100:00100000:3.0:1782480747.246013:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388140288:0@lo:103: 00000100:00100000:0.0:1782480747.246206:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480747.246313:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366096000 00000100:00100000:3.0:1782480747.246320:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366096000 00010000:00010000:2.0:1782480747.246344:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.246352:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf5094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb3b expref: 10 pid: 5794 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.246354:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1782480747.246387:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:3.0:1782480747.246396:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d1301450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366096000:12345-192.168.201.58@tcp:103: 00000100:00100000:0.0:1782480747.246401:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388140672:0@lo:103: 00010000:00010000:3.0:1782480747.246410:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480747.246418:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf5094 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb3b expref: 10 pid: 5794 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.246432:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf5094 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb3b expref: 10 pid: 5794 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480747.246448:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782480747.246500:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf5094 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb3b expref: 10 pid: 5794 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.246503:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480747.246514:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf5024 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf502b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.246522:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480747.246545:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480747.246547:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480747.246549:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480747.246573:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d1301450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:2350:x1869066366096000:12345-192.168.201.58@tcp:103: Request processed in 177us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480747.246576:0:8318:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8318:1869066388138880:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480747.246588:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:3.0:1782480747.246636:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388140672 00000100:00100000:3.0:1782480747.246640:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388140672 00010000:00010000:2.0:1782480747.246644:0:8318:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.246654:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802059000/0x4776e02a9acf502b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5024 expref: 13 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480747.246712:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782480747.246719:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:3312:x1869066388140672:12345-0@lo:103: 00010000:00010000:3.0:1782480747.246727:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480747.246731:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802059000/0x4776e02a9acf502b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5024 expref: 13 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.246740:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802059000/0x4776e02a9acf502b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf5024 expref: 13 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.246751:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802059000/0x4776e02a9acf502b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf5024 expref: 13 pid: 5796 timeout: 427 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.246761:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480747.246796:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:3312:x1869066388140672:12345-0@lo:103: Request processed in 78us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480747.246803:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782480747.246811:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5afb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388140672:0@lo:103: 00000100:00100000:3.0:1782480747.248835:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480747.248890:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366096128 00000100:00100000:0.0:1782480747.248899:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366096128 00010000:00010000:0.0:1782480747.249031:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf508d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb34 expref: 9 pid: 5797 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480747.249106:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:0.0:1782480747.249115:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:2351:x1869066366096128:12345-192.168.201.58@tcp:103: 00010000:00010000:0.0:1782480747.249129:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480747.249134:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf508d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb34 expref: 9 pid: 5797 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249146:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf508d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb34 expref: 9 pid: 5797 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249161:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a3200/0x4776e02a9acf508d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb34 expref: 9 pid: 5797 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249174:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249183:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249211:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249218:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249225:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249231:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249237:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167a200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480747.249240:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249248:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249272:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480747.249283:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480747.249333:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:2351:x1869066366096128:12345-192.168.201.58@tcp:103: Request processed in 219us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480747.249340:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00010000:00010000:3.0:1782480747.249493:0:8318:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.249504:0:8318:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.249510:0:8318:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167a200/0x4776e02a9acf50cc lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8318 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480747.423827:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480748.267870:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480748.268022:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366096256 00000100:00100000:1.0:1782480748.268036:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366096256 00000100:00100000:1.0:1782480748.268113:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:1.0:1782480748.268127:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:5569:x1869066366096256:12345-192.168.201.58@tcp:101: 00010000:00010000:1.0:1782480748.268153:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480748.268186:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c167be00/0x4776e02a9acf50d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fb9d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.268228:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167be00/0x4776e02a9acf50d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb9d expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.268242:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c167be00/0x4776e02a9acf50d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb9d expref: 9 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.268273:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c167be00, rc 0) 00000100:00100000:1.0:1782480748.268353:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5569:x1869066366096256:12345-192.168.201.58@tcp:101: Request processed in 229us (499us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480748.268362:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:1.0:1782480748.279330:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480748.279655:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366096384 00000100:00100000:0.0:1782480748.279713:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366096384 00000100:00100000:0.0:1782480748.279874:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:0.0:1782480748.279886:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5569:x1869066366096384:12345-192.168.201.58@tcp:501: 00000100:00100000:0.0:1782480748.280366:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5569:x1869066366096384:12345-192.168.201.58@tcp:501: Request processed in 479us (1045us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.280377:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:3.0:1782480748.284049:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480748.284324:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366096512 00000100:00100000:2.0:1782480748.284343:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366096512 00000100:00100000:2.0:1782480748.284430:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00100000:2.0:1782480748.284441:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5569:x1869066366096512:12345-192.168.201.58@tcp:503: 00000100:00100000:2.0:1782480748.285023:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5569:x1869066366096512:12345-192.168.201.58@tcp:503: Request processed in 580us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.285033:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00100000:3.0:1782480748.289239:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480748.289378:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366096640 00000100:00100000:1.0:1782480748.289390:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366096640 00000100:00100000:1.0:1782480748.290089:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:1.0:1782480748.290105:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:6036:x1869066366096640:12345-192.168.201.58@tcp:502: 00000100:00100000:1.0:1782480748.290502:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:6036:x1869066366096640:12345-192.168.201.58@tcp:502: Request processed in 400us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480748.290520:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:2.0:1782480748.293864:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480748.294200:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366096768 00000100:00100000:0.0:1782480748.294214:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366096768 00000100:00100000:0.0:1782480748.294271:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:0.0:1782480748.294281:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:6036:x1869066366096768:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480748.294713:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:6036:x1869066366096768:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 430us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.294723:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:0.0:1782480748.301289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480748.301646:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366096896 00000100:00100000:2.0:1782480748.301760:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366096896 00000100:00100000:2.0:1782480748.301880:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 139 00000100:00100000:2.0:1782480748.301893:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5569:x1869066366096896:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480748.301917:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480748.301941:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf50da lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fba4 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.301976:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf50da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fba4 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.302013:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf50da lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fba4 expref: 10 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.302024:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c13a2000, rc 0) 00000100:00100000:2.0:1782480748.302118:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5569:x1869066366096896:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 228us (1076us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.302126:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 139 00000100:00100000:2.0:1782480748.305783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480748.305904:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366097024 00000100:00100000:0.0:1782480748.305919:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366097024 00000100:00100000:0.0:1782480748.305995:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 140 00000100:00100000:0.0:1782480748.306007:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5569:x1869066366097024:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480748.306467:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5569:x1869066366097024:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 460us (697us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782480748.306478:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 140 00000100:00100000:3.0:1782480748.447323:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388140928:0@lo:400: 00010000:00010000:2.0:1782480748.448903:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480748.448943:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388141056:0@lo:400: 00000100:00100000:2.0:1782480748.449034:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.449167:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388141568:0@lo:13: 00000100:00100000:2.0:1782480748.449193:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480748.449347:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.449398:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388141056 00000100:00100000:3.0:1782480748.449406:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388141440:0@lo:400: 00000100:00100000:2.0:1782480748.449409:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388141056 00000100:00100000:3.0:1782480748.449464:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.449492:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388140928 00000100:00100000:2.0:1782480748.449498:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388140928 00000100:00080000:3.0:1782480748.449541:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480748.449548:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782480748.449562:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388141056:12345-0@lo:400: 00000100:00100000:2.0:1782480748.449638:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388141056:12345-0@lo:400: Request processed in 80us (604us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.449645:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782480748.449701:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782480748.449708:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388140928:12345-0@lo:400: 00000100:00100000:2.0:1782480748.449747:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388140928:12345-0@lo:400: Request processed in 40us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.449770:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782480748.449818:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5aa680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388141056:0@lo:400: 00000100:00100000:2.0:1782480748.449851:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388140928:0@lo:400: 00000100:00100000:0.0:1782480748.449955:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388140800:0@lo:400: 00000100:00100000:0.0:1782480748.449997:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480748.450034:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388141312:0@lo:400: 00000100:00100000:0.0:1782480748.450059:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480748.450080:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480748.450086:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388141184:0@lo:400: 00000100:00100000:0.0:1782480748.450109:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480748.450154:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388141312 00000100:00100000:0.0:1782480748.450159:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388141312 00000100:00100000:0.0:1782480748.450197:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782480748.450204:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388141312:12345-0@lo:400: 00000100:00100000:0.0:1782480748.450241:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388141312:12345-0@lo:400: Request processed in 39us (181us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.450246:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782480748.450266:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388141440 00000100:00100000:0.0:1782480748.450269:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388141440 00000100:00100000:0.0:1782480748.450293:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388141184 00000100:00100000:0.0:1782480748.450296:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388141184 00000100:00100000:0.0:1782480748.450310:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480748.450316:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388141440:12345-0@lo:400: 00000100:00100000:0.0:1782480748.450354:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388141440:12345-0@lo:400: Request processed in 37us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.450363:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480748.450375:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782480748.450386:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388141184:12345-0@lo:400: 00000100:00100000:0.0:1782480748.450420:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388141184:12345-0@lo:400: Request processed in 39us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.450428:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1782480748.450429:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480748.450441:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480748.450445:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782480748.450477:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5ab800 x1869066388141184/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480748.450491:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388141184:0@lo:400: 00000100:00100000:0.0:1782480748.450516:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388141312:0@lo:400: 00010000:00080000:3.0:1782480748.450530:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5a8a80 x1869066388141440/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480764 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480748.450548:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388141440:0@lo:400: 00000100:00100000:1.0:1782480748.450721:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388141568 00000100:00100000:1.0:1782480748.450727:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388141568 00000100:00100000:1.0:1782480748.450772:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782480748.450780:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388141568:12345-0@lo:13: 00000100:00100000:2.0:1782480748.452296:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388140800 00000100:00100000:2.0:1782480748.452313:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388140800 00000100:00100000:2.0:1782480748.452397:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1782480748.452408:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:3313:x1869066388140800:12345-0@lo:400: 00000100:00100000:0.0:1782480748.452638:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388140800:0@lo:400: 00002000:00000024:1.0:1782480748.452780:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480748.453292:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ac700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388141568:12345-0@lo:13: Request processed in 2508us (4092us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480748.453304:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:3.0:1782480748.453528:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5ad180 x1869066388141568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480764 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480748.453552:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388141568:0@lo:13: 00000100:00100000:2.0:1782480748.454367:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:3313:x1869066388140800:12345-0@lo:400: Request processed in 103us (2511us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.454389:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 10000000:01000000:1.0:1782480748.898775:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1782480748.898784:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d6c29a2000 from 39 10000000:01000000:1.0:1782480748.898790:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782480748.898843:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.898868:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.898880:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480748.898917:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388141696:0@lo:101: 00000100:00100000:1.0:1782480748.898989:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.899042:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2baa80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480748.900135:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388141696 00000100:00100000:0.0:1782480748.900147:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388141696 00000100:00100000:0.0:1782480748.900213:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782480748.900225:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+12:5799:x1869066388141696:12345-0@lo:101: 00010000:00010000:0.0:1782480748.900240:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480748.900257:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297bc00/0x4776e02a9acf50e8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf50e1 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.900287:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297bc00/0x4776e02a9acf50e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf50e1 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.900298:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297bc00/0x4776e02a9acf50e8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf50e1 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.900314:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297bc00, rc 0) 00000100:00100000:0.0:1782480748.900377:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388141696:12345-0@lo:101: Request processed in 154us (1388us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.900384:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:1.0:1782480748.900707:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388141696:0@lo:101: 00010000:00010000:1.0:1782480748.900727:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.900736:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480748.900805:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388141824:0@lo:501: 00000100:00100000:1.0:1782480748.900836:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.900871:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2baa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.901185:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388141824 00000100:00100000:2.0:1782480748.901190:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388141824 00000100:00100000:2.0:1782480748.901221:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1782480748.901228:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388141824:12345-0@lo:501: 00000100:00100000:2.0:1782480748.901517:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388141824:12345-0@lo:501: Request processed in 288us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.901525:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1782480748.901930:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388141824:0@lo:501: 00000100:00100000:1.0:1782480748.901966:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388141952:0@lo:503: 00000100:00100000:1.0:1782480748.902020:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.902054:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2baa80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.902293:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388141952 00000100:00100000:2.0:1782480748.902299:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388141952 00000100:00100000:2.0:1782480748.902336:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1782480748.902344:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388141952:12345-0@lo:503: 00000100:00100000:2.0:1782480748.902514:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388141952:12345-0@lo:503: Request processed in 170us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.902522:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1782480748.906375:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388141952:0@lo:503: 00000100:00100000:1.0:1782480748.907650:0:8340:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8340:1869066388142080:0@lo:502: 00000100:00100000:1.0:1782480748.907781:0:8340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.907815:0:8340:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2bad80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480748.908176:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388142080 00000100:00100000:0.0:1782480748.908184:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388142080 00000100:00100000:0.0:1782480748.908239:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:0.0:1782480748.908248:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:8340:x1869066388142080:12345-0@lo:502: 00000100:00100000:0.0:1782480748.908796:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:8340:x1869066388142080:12345-0@lo:502: Request processed in 547us (1013us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.908804:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1782480748.911527:0:8340:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8340:1869066388142080:0@lo:502: 00000100:00100000:1.0:1782480748.911625:0:8340:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8340:1869066388142208:0@lo:502: 00000100:00100000:1.0:1782480748.911758:0:8340:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.911792:0:8340:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2bad80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480748.912249:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388142208 00000100:00100000:0.0:1782480748.912257:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388142208 00000100:00100000:0.0:1782480748.912312:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1782480748.912322:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:8340:x1869066388142208:12345-0@lo:502: 00000100:00100000:0.0:1782480748.912827:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:8340:x1869066388142208:12345-0@lo:502: Request processed in 503us (1066us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.912836:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782480748.913166:0:8340:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8340:1869066388142208:0@lo:502: 00000040:00080000:1.0:1782480748.913196:0:8340:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782480748.923191:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782480748.923240:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782480748.923255:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.923267:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480748.923290:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1782480748.923293:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1782480748.923296:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1782480748.923337:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.923345:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.923356:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.923379:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388142336:0@lo:101: 00000100:00100000:2.0:1782480748.923448:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.923488:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67add80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480748.923586:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388142336 00000100:00100000:0.0:1782480748.923594:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388142336 00000100:00100000:0.0:1782480748.923654:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1782480748.923702:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+13:5799:x1869066388142336:12345-0@lo:101: 00010000:00010000:0.0:1782480748.923715:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480748.923729:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297aa00/0x4776e02a9acf50f6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf50ef expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.923788:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297aa00/0x4776e02a9acf50f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf50ef expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.923799:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297aa00/0x4776e02a9acf50f6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf50ef expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.923808:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297aa00, rc 0) 00000100:00100000:0.0:1782480748.923858:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388142336:12345-0@lo:101: Request processed in 160us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.923866:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:3.0:1782480748.924148:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ac000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388142336:0@lo:101: 00010000:00010000:3.0:1782480748.924163:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480748.924172:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480748.924259:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388142464:0@lo:501: 00000100:00100000:3.0:1782480748.924342:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480748.924396:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c57e7600 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.924703:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388142464 00000100:00100000:2.0:1782480748.924708:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388142464 00000100:00100000:2.0:1782480748.924744:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782480748.924752:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388142464:12345-0@lo:501: 00000100:00100000:2.0:1782480748.925045:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388142464:12345-0@lo:501: Request processed in 293us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.925053:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1782480748.925090:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388142464:0@lo:501: 00000100:00100000:2.0:1782480748.925130:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388142592:0@lo:503: 00000100:00100000:2.0:1782480748.925171:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.925187:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67ad840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.925198:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388142592 00000100:00100000:2.0:1782480748.925201:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388142592 00000100:00100000:2.0:1782480748.925218:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782480748.925224:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388142592:12345-0@lo:503: 00000100:00100000:2.0:1782480748.925373:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388142592:12345-0@lo:503: Request processed in 148us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.925380:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1782480748.925411:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388142592:0@lo:503: 00000100:00100000:2.0:1782480748.925623:0:8342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8342:1869066388142720:0@lo:502: 00000100:00100000:2.0:1782480748.925655:0:8342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.925709:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388142720 00000100:00100000:2.0:1782480748.925713:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388142720 00000100:00100000:2.0:1782480748.925731:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782480748.925737:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:8342:x1869066388142720:12345-0@lo:502: 00000100:00100000:2.0:1782480748.925857:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:8342:x1869066388142720:12345-0@lo:502: Request processed in 119us (201us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.925864:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1782480748.925893:0:8342:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67add80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.925905:0:8342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8342:1869066388142720:0@lo:502: 00000020:01000000:2.0:1782480748.925925:0:8342:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480748.925935:0:8342:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480748.925937:0:8342:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782480748.925942:0:8342:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1782480748.925968:0:8342:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8342:1869066388142848:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480748.925998:0:8342:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.926016:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388142848 00000100:00100000:2.0:1782480748.926019:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388142848 00000100:00100000:2.0:1782480748.926036:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782480748.926041:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:8342:x1869066388142848:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480748.926138:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:8342:x1869066388142848:12345-0@lo:502:llog_process_th.0 Request processed in 96us (139us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.926145:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1782480748.926173:0:8342:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67add80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.926184:0:8342:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8342:1869066388142848:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782480748.926201:0:8342:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480748.926205:0:8342:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480748.926207:0:8342:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782480748.926210:0:8342:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1782480748.926254:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1782480748.926273:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1782480748.926283:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.926292:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480748.926302:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782480748.926305:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d7c7ca2800 from 39 10000000:01000000:2.0:1782480748.926307:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782480748.926330:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.926347:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.926356:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.926368:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388142976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.926391:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.926403:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67add80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.926413:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388142976 00000100:00100000:2.0:1782480748.926416:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388142976 00000100:00100000:2.0:1782480748.926431:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782480748.926436:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:5799:x1869066388142976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480748.926442:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480748.926452:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c13a3a00/0x4776e02a9acf5104 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf50fd expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.926472:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c13a3a00/0x4776e02a9acf5104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf50fd expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.926481:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c13a3a00/0x4776e02a9acf5104 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf50fd expref: 15 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.926490:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c13a3a00, rc 0) 00000100:00100000:2.0:1782480748.926516:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388142976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 80us (124us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.926522:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1782480748.926556:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388142976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480748.926567:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.926575:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.926610:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388143104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.926633:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.926644:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67add80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.926654:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388143104 00000100:00100000:2.0:1782480748.926691:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388143104 00000100:00100000:2.0:1782480748.926709:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782480748.926715:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388143104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.926908:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388143104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 192us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.926915:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1782480748.926958:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388143104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.926983:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388143232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.927013:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.927026:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4d80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.927037:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388143232 00000100:00100000:2.0:1782480748.927040:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388143232 00000100:00100000:2.0:1782480748.927055:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782480748.927061:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388143232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.927176:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388143232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (162us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.927189:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:2.0:1782480748.927220:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388143232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480748.935958:0:8343:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8343:1869066388143360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480748.936052:0:8343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480748.936094:0:8343:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8031840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.936169:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388143360 00000100:00100000:2.0:1782480748.936177:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388143360 00000100:00100000:2.0:1782480748.936230:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:2.0:1782480748.936238:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:8343:x1869066388143360:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480748.936472:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:8343:x1869066388143360:12345-0@lo:502:llog_process_th.0 Request processed in 233us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.936480:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1782480748.936576:0:8343:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8343:1869066388143360:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480748.936625:0:8343:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8343:1869066388143488:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480748.936654:0:8343:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480748.936716:0:8343:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8031840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.936826:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388143488 00000100:00100000:2.0:1782480748.936830:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388143488 00000100:00100000:2.0:1782480748.936863:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1782480748.936870:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:8343:x1869066388143488:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480748.936995:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:8343:x1869066388143488:12345-0@lo:502:llog_process_th.0 Request processed in 125us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.937002:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782480748.937164:0:8343:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8343:1869066388143488:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782480748.937185:0:8343:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782480748.937299:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782480748.937315:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782480748.937326:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.937336:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480748.937346:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1782480748.937348:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1782480748.937357:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782480748.937381:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.937390:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.937398:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.937413:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388143616:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.937440:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.937458:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.937471:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388143616 00000100:00100000:2.0:1782480748.937476:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388143616 00000100:00100000:2.0:1782480748.937498:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782480748.937505:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:5799:x1869066388143616:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480748.937513:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480748.937523:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c13a3600/0x4776e02a9acf5112 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf510b expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.937544:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c13a3600/0x4776e02a9acf5112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf510b expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.937554:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c13a3600/0x4776e02a9acf5112 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf510b expref: 16 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.937563:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c13a3600, rc 0) 00000100:00100000:2.0:1782480748.937590:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388143616:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 86us (149us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.937606:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:2.0:1782480748.937637:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388143616:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480748.937649:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.937719:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.937761:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388143744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.937787:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.937801:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.937812:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388143744 00000100:00100000:2.0:1782480748.937815:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388143744 00000100:00100000:2.0:1782480748.937835:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782480748.937841:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388143744:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.938067:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388143744:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 225us (277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.938073:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:2.0:1782480748.938101:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388143744:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.938127:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388143872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.938159:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.938173:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.938184:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388143872 00000100:00100000:2.0:1782480748.938187:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388143872 00000100:00100000:2.0:1782480748.938207:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782480748.938220:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388143872:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.938335:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388143872:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 115us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.938341:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782480748.938377:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388143872:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480748.959175:0:8344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8344:1869066388144000:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480748.959285:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.959337:0:8344:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2bad80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.959392:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388144000 00000100:00100000:2.0:1782480748.959401:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388144000 00000100:00100000:2.0:1782480748.959456:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782480748.959466:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:8344:x1869066388144000:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480748.959735:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:8344:x1869066388144000:12345-0@lo:502:llog_process_th.0 Request processed in 270us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.959742:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1782480748.959843:0:8344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8344:1869066388144000:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480748.959872:0:8344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480748.959882:0:8344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480748.959885:0:8344:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782480748.959892:0:8344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782480748.959927:0:8344:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8344:1869066388144128:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480748.959962:0:8344:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.959986:0:8344:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2bad80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.960085:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388144128 00000100:00100000:2.0:1782480748.960090:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388144128 00000100:00100000:2.0:1782480748.960125:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782480748.960132:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:8344:x1869066388144128:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480748.960257:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:8344:x1869066388144128:12345-0@lo:502:llog_process_th.0 Request processed in 125us (293us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.960263:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1782480748.960336:0:8344:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8344:1869066388144128:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480748.960353:0:8344:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480748.960357:0:8344:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480748.960359:0:8344:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782480748.960363:0:8344:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1782480748.960525:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1782480748.960547:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1782480748.960557:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.960568:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480748.960588:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1782480748.960591:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d7c52cd800 from 39 10000000:01000000:2.0:1782480748.960594:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1782480748.960620:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.960628:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.960636:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.960651:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388144256:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.960716:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.960734:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480748.960787:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388144256 00000100:00100000:1.0:1782480748.960791:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388144256 00000100:00100000:1.0:1782480748.960829:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1782480748.960834:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388144256:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480748.960843:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480748.960856:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c167ac00/0x4776e02a9acf5120 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5119 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.960877:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167ac00/0x4776e02a9acf5120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5119 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.960886:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c167ac00/0x4776e02a9acf5120 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5119 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.960895:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c167ac00, rc 0) 00000100:00100000:1.0:1782480748.960936:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388144256:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 101us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480748.960941:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1782480748.961059:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388144256:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480748.961071:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.961079:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.961122:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388144384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.961146:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.961165:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e49c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480748.961229:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388144384 00000100:00100000:0.0:1782480748.961234:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388144384 00000100:00100000:0.0:1782480748.961268:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:0.0:1782480748.961275:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388144384:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480748.961503:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388144384:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 227us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.961511:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1782480748.961575:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388144384:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.961602:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388144512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.961639:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.961686:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e49c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480748.961988:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388144512 00000100:00100000:1.0:1782480748.961993:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388144512 00000100:00100000:1.0:1782480748.962024:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1782480748.962032:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388144512:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480748.962168:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388144512:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 136us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480748.962174:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:2.0:1782480748.962247:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388144512:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480748.987265:0:8345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8345:1869066388144640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480748.987362:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480748.987415:0:8345:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8031cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.987823:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388144640 00000100:00100000:2.0:1782480748.987832:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388144640 00000100:00100000:2.0:1782480748.987887:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:2.0:1782480748.987906:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:8345:x1869066388144640:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480748.988155:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:8345:x1869066388144640:12345-0@lo:502:llog_process_th.0 Request processed in 259us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.988163:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782480748.988317:0:8345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8345:1869066388144640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480748.988370:0:8345:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8345:1869066388144768:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480748.988408:0:8345:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480748.988433:0:8345:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8031cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.988866:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388144768 00000100:00100000:2.0:1782480748.988872:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388144768 00000100:00100000:2.0:1782480748.988918:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782480748.988926:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:8345:x1869066388144768:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480748.989088:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:8345:x1869066388144768:12345-0@lo:502:llog_process_th.0 Request processed in 162us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.989094:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1782480748.993140:0:8345:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8345:1869066388144768:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1782480748.993195:0:8345:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1782480748.993465:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1782480748.993489:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782480748.993502:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.993513:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480748.993523:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1782480748.993525:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:2.0:1782480748.993541:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1782480748.993580:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.993588:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.993597:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.993620:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388144896:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.993718:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.993759:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480748.993939:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388144896 00000100:00100000:0.0:1782480748.993945:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388144896 00000100:00100000:0.0:1782480748.993992:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1782480748.994001:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388144896:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480748.994014:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480748.994026:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297ac00/0x4776e02a9acf512e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5127 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.994058:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297ac00/0x4776e02a9acf512e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5127 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.994069:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297ac00/0x4776e02a9acf512e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5127 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480748.994077:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297ac00, rc 0) 00000100:00100000:0.0:1782480748.994116:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388144896:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 117us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.994123:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1782480748.994253:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388144896:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480748.994266:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480748.994275:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480748.994318:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388145024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.994341:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.994363:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480748.994495:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388145024 00000100:00100000:0.0:1782480748.994499:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388145024 00000100:00100000:0.0:1782480748.994527:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1782480748.994534:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388145024:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480748.994954:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388145024:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 419us (610us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480748.994961:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1782480748.995071:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388145024:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480748.995103:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388145152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480748.995142:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.995164:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2bacc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480748.995219:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388145152 00000100:00100000:2.0:1782480748.995224:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388145152 00000100:00100000:2.0:1782480748.995254:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782480748.995261:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388145152:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.995391:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388145152:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 131us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480748.995403:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782480748.995437:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388145152:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480748.995635:0:8346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8346:1869066388145280:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480748.995817:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480748.995838:0:8346:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4480 going to sleep for 11 seconds 00000100:00100000:1.0:1782480748.995875:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388145280 00000100:00100000:1.0:1782480748.995880:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388145280 00000100:00100000:1.0:1782480748.995921:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782480748.995929:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:8346:x1869066388145280:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480748.996085:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:8346:x1869066388145280:12345-0@lo:502:llog_process_th.0 Request processed in 157us (267us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480748.996092:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:1.0:1782480748.996130:0:8346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ad500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8346:1869066388145280:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480748.996157:0:8346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480748.996166:0:8346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480748.996168:0:8346:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782480748.996175:0:8346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782480748.996196:0:8346:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8346:1869066388145408:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480748.996228:0:8346:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.996249:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388145408 00000100:00100000:1.0:1782480748.996252:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388145408 00000100:00100000:1.0:1782480748.996268:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782480748.996274:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:8346:x1869066388145408:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480748.996385:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:8346:x1869066388145408:12345-0@lo:502:llog_process_th.0 Request processed in 111us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480748.996391:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:1.0:1782480748.996415:0:8346:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2ba900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480748.996426:0:8346:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8346:1869066388145408:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480748.996442:0:8346:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480748.996446:0:8346:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480748.996447:0:8346:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782480748.996451:0:8346:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1782480748.996503:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:1.0:1782480748.996518:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782480748.996527:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.996537:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480748.996547:0:5799:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:1.0:1782480748.996549:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91d7c2d04d40 from 1 10000000:01000000:1.0:1782480748.996551:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1782480748.996573:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167a800/0x4776e02a9acf5135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.996581:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c167a800/0x4776e02a9acf5135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.996590:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c167a800/0x4776e02a9acf5135 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480748.996602:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388145536:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782480748.996627:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.996641:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2ba900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480748.996652:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388145536 00000100:00100000:1.0:1782480748.996655:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388145536 00000100:00100000:1.0:1782480748.996710:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782480748.996717:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388145536:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480748.996725:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480748.996735:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c167b400/0x4776e02a9acf513c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5135 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.996765:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167b400/0x4776e02a9acf513c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5135 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.996775:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c167b400/0x4776e02a9acf513c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5135 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.996784:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c167b400, rc 0) 00000100:00100000:1.0:1782480748.996815:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388145536:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 99us (188us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480748.996821:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:1.0:1782480748.996848:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388145536:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480748.996859:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c167a800/0x4776e02a9acf5135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf513c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.996868:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c167a800/0x4776e02a9acf5135 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf513c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480748.996906:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388145664:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480748.996928:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480748.996940:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2ba900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480748.996950:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388145664 00000100:00100000:1.0:1782480748.996953:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388145664 00000100:00100000:1.0:1782480748.996968:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782480748.996973:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388145664:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480748.997149:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388145664:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 175us (219us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782480748.997164:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:1.0:1782480748.997190:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388145664:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1782480748.997207:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1782480748.997212:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167a800/0x4776e02a9acf5135 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf513c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480748.997220:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c167a800/0x4776e02a9acf5135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf513c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.479402:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782480749.808600:0:8378:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6f437750 20000000:00000080:1.0:1782480749.808617:0:8378:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d7c4af9000 uarg=0000000000000000 20000000:01000000:1.0:1782480749.810122:0:8378:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782480749.810129:0:8378:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:1.0:1782480749.810134:0:8378:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1782480749.814500:0:8379:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:1.0:1782480749.818422:0:8378:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1782480749.843349:0:8378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1782480749.843404:0:8378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1782480749.843532:0:8378:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1782480749.843551:0:8378:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1782480749.843572:0:8378:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.843590:0:8378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c13a2c00/0x4776e02a9acf4eb8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4eb1 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.843598:0:8378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802058000/0x4776e02a9acf4f1a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4f13 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.843604:0:8378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4fe5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf4fde expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.843613:0:8378:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d6c297a800/0x4776e02a9acf50a2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb6c expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.843621:0:8378:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.843710:0:8378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d6c297a800/0x4776e02a9acf50a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb6c expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.843734:0:8378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d6c297a800/0x4776e02a9acf50a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb6c expref: 9 pid: 5796 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480749.843753:0:8378:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8378:1869066388145792:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480749.843864:0:8378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4fe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4fde expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.843872:0:8378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4fe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4fde expref: 18 pid: 5794 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480749.843881:0:8378:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8378:1869066388145920:0@lo:104: 00000100:00100000:2.0:1782480749.843923:0:8378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782480749.843951:0:8378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802058000/0x4776e02a9acf4f1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4f13 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.843959:0:8378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d802058000/0x4776e02a9acf4f1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4f13 expref: 18 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480749.843966:0:8378:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8378:1869066388146048:0@lo:104: 00000100:00100000:2.0:1782480749.843988:0:8378:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782480749.844008:0:8378:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c13a2c00/0x4776e02a9acf4eb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf4eb1 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.844015:0:8378:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c13a2c00/0x4776e02a9acf4eb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf4eb1 expref: 18 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480749.844023:0:8378:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8378:1869066388146176:0@lo:104: 00000100:00100000:2.0:1782480749.844041:0:8378:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c50f90c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480749.844544:0:5784:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782480749.844579:0:5784:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480749.844599:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388145920 00000100:00100000:0.0:1782480749.844608:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388145920 00000100:00100000:0.0:1782480749.844687:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388146048 00000100:00100000:0.0:1782480749.844691:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388146048 00000100:00100000:0.0:1782480749.844702:0:5784:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388146176 00000100:00100000:0.0:1782480749.844704:0:5784:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388146176 00000100:00100000:0.0:1782480749.844717:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782480749.844726:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:8378:x1869066388145920:12345-0@lo:104: 00010000:00010000:0.0:1782480749.844750:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.844810:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782480749.844817:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5af100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:8378:x1869066388145920:12345-0@lo:104: Request processed in 93us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480749.844824:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782480749.844844:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782480749.844850:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efeb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:8378:x1869066388146048:12345-0@lo:104: 00010000:00010000:0.0:1782480749.844857:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.844894:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1782480749.844900:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efeb8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:8378:x1869066388146048:12345-0@lo:104: Request processed in 51us (911us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480749.844905:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782480749.844937:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782480749.844943:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:8378:x1869066388146176:12345-0@lo:104: 00010000:00010000:0.0:1782480749.844950:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3e00/0x4776e02a9acf4eb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.844982:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1782480749.844987:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:8378:x1869066388146176:12345-0@lo:104: Request processed in 46us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480749.844992:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1782480749.845013:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782480749.845018:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845036:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058c00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480749.845041:0:8324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845049:0:8324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480749.845056:0:8324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480749.845062:0:8324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782480749.845096:0:8324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845103:0:8324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480749.845192:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845200:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d802058c00/0x4776e02a9acf4fde lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4fe5 expref: -99 pid: 7499 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845215:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782480749.845218:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845225:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b600 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480749.845228:0:8324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845359:0:8324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480749.845365:0:8324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480749.845370:0:8324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782480749.845387:0:8324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845392:0:8324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480749.845398:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845404:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167b600/0x4776e02a9acf4f13 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4f1a expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845414:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480749.845417:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3e00/0x4776e02a9acf4eb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845422:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c13a3e00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480749.845424:0:8324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3e00/0x4776e02a9acf4eb1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845433:0:8324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3e00/0x4776e02a9acf4eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480749.845438:0:8324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3e00/0x4776e02a9acf4eb1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480749.845450:0:8324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782480749.845462:0:8324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3e00/0x4776e02a9acf4eb1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845466:0:8324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480749.845478:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3e00/0x4776e02a9acf4eb1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845484:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3e00/0x4776e02a9acf4eb1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf4eb8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.845496:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480749.845498:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480749.845499:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480749.845507:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480749.845519:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388146304:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782480749.845780:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480749.845791:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388146560:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480749.850156:0:8378:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5af480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8378:1869066388145920:0@lo:104: 00000100:00100000:3.0:1782480749.850171:0:8378:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5adc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8378:1869066388146048:0@lo:104: 00000100:00100000:3.0:1782480749.850179:0:8378:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ad880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8378:1869066388146176:0@lo:104: 00000100:00100000:0.0:1782480749.850456:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480749.850733:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480749.850805:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388146304 00000100:00100000:2.0:1782480749.850812:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388146304 00010000:00010000:2.0:1782480749.850859:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4fe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4fde expref: 19 pid: 5794 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480749.850887:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388146560 00000100:00100000:2.0:1782480749.850890:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388146560 00010000:00010000:2.0:1782480749.850901:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c13a2c00/0x4776e02a9acf4eb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4eb1 expref: 20 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480749.850916:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782480749.850924:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+20:3312:x1869066388146304:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480749.850941:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480749.850946:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4fe5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4fde expref: 20 pid: 5794 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.850957:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4fe5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4fde expref: 20 pid: 5794 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.850974:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802058a00/0x4776e02a9acf4fe5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4fde expref: 20 pid: 5794 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.851002:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480749.851056:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388146304:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480749.851064:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1782480749.851080:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782480749.851086:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3310:x1869066388146560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480749.851093:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480749.851111:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c13a2c00/0x4776e02a9acf4eb8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4eb1 expref: 18 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.851119:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c13a2c00/0x4776e02a9acf4eb8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4eb1 expref: 18 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.851128:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a2c00/0x4776e02a9acf4eb8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4eb1 expref: 18 pid: 5796 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480749.851138:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480749.851168:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ac380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3310:x1869066388146560:12345-0@lo:103:ldlm_bl.0 Request processed in 82us (435us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480749.851174:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782480749.851206:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388146560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480749.851502:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388146432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480749.851508:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388146304:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480749.851770:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480749.851844:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388146432 00000100:00100000:3.0:1782480749.851849:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388146432 00010000:00010000:3.0:1782480749.851871:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802058000/0x4776e02a9acf4f1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f13 expref: 17 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480749.851897:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782480749.851904:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3313:x1869066388146432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782480749.851913:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480749.851917:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802058000/0x4776e02a9acf4f1a lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf4f13 expref: 17 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.851926:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802058000/0x4776e02a9acf4f1a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf4f13 expref: 17 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.851937:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802058000/0x4776e02a9acf4f1a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf4f13 expref: 17 pid: 5797 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.851948:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480749.851985:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ae300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3313:x1869066388146432:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480749.851991:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782480749.853129:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388146432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480749.863337:0:8378:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5aed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8378:1869066388145792:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480749.863393:0:8378:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480749.866061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480749.866111:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366097152 00000100:00100000:3.0:1782480749.866123:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366097152 00010000:00010000:3.0:1782480749.866174:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d6c297a800/0x4776e02a9acf50a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb6c expref: 10 pid: 5796 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480749.866226:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:3.0:1782480749.866235:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366097152:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480749.866253:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480749.866258:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d6c297a800/0x4776e02a9acf50a2 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb6c expref: 10 pid: 5796 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866270:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d6c297a800/0x4776e02a9acf50a2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb6c expref: 10 pid: 5796 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866287:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297a800/0x4776e02a9acf50a2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb6c expref: 10 pid: 5796 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866305:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866314:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866329:0:5788:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866336:0:5788:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866342:0:5788:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866348:0:5788:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866359:0:5788:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782480749.866363:0:5788:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866371:0:5788:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866389:0:5788:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480749.866399:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480749.866448:0:8378:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.866466:0:8378:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480749.866489:0:8378:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802059400/0x4776e02a9acf5143 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8378 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480749.868138:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:2350:x1869066366097152:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1891us (2074us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480749.868153:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00010000:00010000:0.0:1782480750.496624:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480751.018518:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388146688:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480751.018641:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480751.018821:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388146688 00000100:00100000:1.0:1782480751.018835:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388146688 00000100:00080000:3.0:1782480751.018894:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480751.018926:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1782480751.018938:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388146688:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480751.018977:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480751.019146:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388146688:12345-0@lo:13:osp-pre-0-0.0 Request processed in 208us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480751.019155:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1782480751.021273:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef6c8a80 x1869066388146688/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480767 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480751.021304:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388146688:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782480751.520582:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782480751.646739:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782480751.646748:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d6c29a2000 from 4 10000000:01000000:1.0:1782480751.646755:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480751.646813:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480751.646832:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480751.646845:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480751.646875:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388146816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782480751.646956:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480751.647012:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2ba900 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.647061:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388146816 00000100:00100000:3.0:1782480751.647073:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388146816 00000100:00100000:3.0:1782480751.647153:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782480751.647164:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388146816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480751.647183:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480751.647202:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779ba00/0x4776e02a9acf5151 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf514a expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.647241:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779ba00/0x4776e02a9acf5151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf514a expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.647254:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779ba00/0x4776e02a9acf5151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf514a expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.647265:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ba00, rc 0) 00000100:00100000:3.0:1782480751.647318:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388146816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 156us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.647327:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:3.0:1782480751.647400:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6cbb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388146816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480751.647419:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.647429:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480751.647514:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388146944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.647546:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480751.647577:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480751.647650:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388146944 00000100:00100000:1.0:1782480751.647656:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388146944 00000100:00100000:1.0:1782480751.647702:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1782480751.647710:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388146944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480751.647983:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388146944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 273us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480751.647988:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:3.0:1782480751.648058:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388146944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.648092:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388147072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.648135:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480751.648174:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4180 going to sleep for 11 seconds 00000100:00100000:1.0:1782480751.648402:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388147072 00000100:00100000:1.0:1782480751.648407:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388147072 00000100:00100000:1.0:1782480751.648450:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782480751.648458:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388147072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480751.648632:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388147072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480751.648640:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:3.0:1782480751.649078:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388147072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.650576:0:8440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8440:1869066388147200:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480751.650842:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480751.650975:0:8440:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480751.651100:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388147200 00000100:00100000:1.0:1782480751.651109:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388147200 00000100:00100000:1.0:1782480751.651172:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:1.0:1782480751.651191:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:8440:x1869066388147200:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480751.653008:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:8440:x1869066388147200:12345-0@lo:502:llog_process_th.0 Request processed in 1808us (2155us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480751.653024:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1782480751.658699:0:8440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8440:1869066388147200:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480751.658772:0:8440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480751.658787:0:8440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480751.658790:0:8440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782480751.658799:0:8440:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d6c29a2000 00000020:00000080:3.0:1782480751.658801:0:8440:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782480751.658928:0:8440:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8440:1869066388147328:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480751.659031:0:8440:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480751.659079:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388147328 00000100:00100000:3.0:1782480751.659087:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388147328 00000100:00100000:3.0:1782480751.659146:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782480751.659158:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:8440:x1869066388147328:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480751.661856:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:8440:x1869066388147328:12345-0@lo:502:llog_process_th.0 Request processed in 2686us (2812us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.661873:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1782480751.661972:0:8440:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.662004:0:8440:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8440:1869066388147328:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480751.662046:0:8440:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480751.662056:0:8440:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480751.662059:0:8440:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782480751.662064:0:8440:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:1.0:1782480751.664704:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:1.0:1782480751.664751:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782480751.664768:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480751.664783:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480751.664797:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782480751.664800:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c7ca2800 from 4 10000000:01000000:1.0:1782480751.664803:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480751.664859:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480751.664868:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480751.664879:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480751.664912:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388147456:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782480751.665010:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480751.665059:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2ba840 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.665709:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388147456 00000100:00100000:3.0:1782480751.665721:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388147456 00000100:00100000:3.0:1782480751.665789:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782480751.665798:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388147456:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480751.665816:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480751.665832:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779a200/0x4776e02a9acf515f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5158 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.665863:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779a200/0x4776e02a9acf515f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5158 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.665873:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779a200/0x4776e02a9acf515f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5158 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.665884:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a200, rc 0) 00000100:00100000:3.0:1782480751.665951:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388147456:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (941us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.665959:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:3.0:1782480751.666021:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388147456:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480751.666041:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.666050:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480751.666125:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388147584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.666157:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480751.666174:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.666190:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388147584 00000100:00100000:3.0:1782480751.666193:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388147584 00000100:00100000:3.0:1782480751.666224:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782480751.666230:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388147584:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.667878:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388147584:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1637us (1709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.667893:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782480751.667970:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388147584:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.668030:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388147712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.668079:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480751.668096:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.668114:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388147712 00000100:00100000:3.0:1782480751.668119:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388147712 00000100:00100000:3.0:1782480751.668151:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782480751.668158:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388147712:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.668328:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388147712:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 169us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.668351:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:3.0:1782480751.673801:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388147712:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.674253:0:8443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8443:1869066388147840:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480751.674351:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480751.674406:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388147840 00000100:00100000:3.0:1782480751.674414:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388147840 00000100:00100000:3.0:1782480751.674464:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782480751.674474:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:8443:x1869066388147840:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480751.674789:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:8443:x1869066388147840:12345-0@lo:502:llog_process_th.0 Request processed in 315us (437us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.674804:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1782480751.674866:0:8443:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c2c54e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.674882:0:8443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8443:1869066388147840:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480751.674910:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1782480751.674922:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480751.674924:0:8443:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1782480751.674931:0:8443:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d7c7ca2800 00000020:00000080:3.0:1782480751.674934:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1782480751.675570:0:8443:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8443:1869066388147968:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480751.676646:0:8443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480751.676721:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388147968 00000100:00100000:3.0:1782480751.676731:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388147968 00000100:00100000:3.0:1782480751.676786:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782480751.676796:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:8443:x1869066388147968:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480751.677073:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:8443:x1869066388147968:12345-0@lo:502:llog_process_th.0 Request processed in 277us (431us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.677082:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1782480751.677150:0:8443:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c2c54e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.677176:0:8443:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8443:1869066388147968:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1782480751.677211:0:8443:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480751.677221:0:8443:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480751.677223:0:8443:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1782480751.677228:0:8443:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782480751.677300:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782480751.677320:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782480751.677332:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.677352:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480751.677364:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782480751.677368:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c52cd800 from 4 10000000:01000000:3.0:1782480751.677371:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782480751.677407:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.677416:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.677577:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480751.677785:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388148096:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.677831:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480751.677850:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.677869:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388148096 00000100:00100000:3.0:1782480751.677875:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388148096 00000100:00100000:3.0:1782480751.677904:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782480751.677912:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388148096:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480751.677925:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480751.677941:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf516d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5166 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.677968:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf516d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5166 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.677993:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf516d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5166 expref: 19 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.678004:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a400, rc 0) 00000100:00100000:3.0:1782480751.678037:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388148096:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 125us (205us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.678043:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:3.0:1782480751.678078:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388148096:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480751.678092:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.678101:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480751.680550:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388148224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.680650:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480751.680707:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c2c54c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.680745:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388148224 00000100:00100000:3.0:1782480751.680753:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388148224 00000100:00100000:3.0:1782480751.680823:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:3.0:1782480751.680832:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388148224:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.683598:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388148224:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2751us (2932us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.683626:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:1.0:1782480751.684044:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388148224:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480751.684118:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388148352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480751.684205:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480751.684258:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2bae40 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.684310:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388148352 00000100:00100000:3.0:1782480751.684319:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388148352 00000100:00100000:3.0:1782480751.684385:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:3.0:1782480751.684394:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388148352:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.684638:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388148352:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 244us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.684646:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1782480751.684763:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388148352:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480751.685417:0:8445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8445:1869066388148480:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480751.685478:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480751.685513:0:8445:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2ba300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480751.685555:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388148480 00000100:00100000:3.0:1782480751.685561:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388148480 00000100:00100000:3.0:1782480751.685599:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:3.0:1782480751.685609:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:8445:x1869066388148480:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480751.685834:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:8445:x1869066388148480:12345-0@lo:502:llog_process_th.0 Request processed in 225us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.685843:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1782480751.688404:0:8445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8445:1869066388148480:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480751.688474:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480751.688489:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480751.688492:0:8445:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782480751.688500:0:8445:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d7c52cd800 00000020:00000080:1.0:1782480751.688504:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782480751.688640:0:8445:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8445:1869066388148608:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480751.688754:0:8445:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480751.688802:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388148608 00000100:00100000:1.0:1782480751.688811:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388148608 00000100:00100000:1.0:1782480751.688869:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782480751.688879:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:8445:x1869066388148608:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480751.689160:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:8445:x1869066388148608:12345-0@lo:502:llog_process_th.0 Request processed in 282us (406us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480751.689169:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1782480751.689227:0:8445:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2ba300 going to sleep for 11 seconds 00000100:00100000:1.0:1782480751.689240:0:8445:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:8445:1869066388148608:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480751.689261:0:8445:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480751.689266:0:8445:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480751.689275:0:8445:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1782480751.689279:0:8445:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1782480751.690048:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1782480751.690075:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782480751.690089:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.690104:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480751.851104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480751.852952:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366097280 00000100:00100000:3.0:1782480751.852973:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366097280 00000100:00100000:3.0:1782480751.853068:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:3.0:1782480751.853081:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:5569:x1869066366097280:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480751.853104:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480751.853128:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779a800/0x4776e02a9acf5174 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fbab expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.853190:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779a800/0x4776e02a9acf5174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbab expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.853203:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779a800/0x4776e02a9acf5174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbab expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480751.853214:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a800, rc 0) 00000100:00100000:3.0:1782480751.853286:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5569:x1869066366097280:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 209us (2199us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.853294:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:3.0:1782480751.860013:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480751.870816:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366097408 00000100:00100000:2.0:1782480751.870839:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366097408 00000100:00100000:3.0:1782480751.871307:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:3.0:1782480751.871320:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5569:x1869066366097408:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480751.871780:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5569:x1869066366097408:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 459us (11791us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.874707:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:2.0:1782480751.882560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480751.883301:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366097536 00000100:00100000:0.0:1782480751.883316:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366097536 00000100:00100000:1.0:1782480751.883557:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:1.0:1782480751.883572:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5569:x1869066366097536:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480751.884128:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:5569:x1869066366097536:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 556us (1578us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480751.884137:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:2.0:1782480751.894586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480751.894944:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366097664 00000100:00100000:3.0:1782480751.894959:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366097664 00000100:00100000:3.0:1782480751.895090:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 192 00000100:00100000:3.0:1782480751.895102:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:6099:x1869066366097664:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782480751.895428:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:6099:x1869066366097664:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 327us (856us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480751.895437:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 192 00000100:00100000:3.0:1782480751.911130:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480751.911750:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366097792 00000100:00100000:0.0:1782480751.911766:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366097792 00000100:00100000:0.0:1782480751.911858:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 193 00000100:00100000:0.0:1782480751.911869:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:6099:x1869066366097792:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480751.912220:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:6099:x1869066366097792:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 352us (1218us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480751.912229:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 193 00000100:00100000:2.0:1782480752.113267:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480752.113331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480752.113377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480752.113942:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366097920 00000100:00100000:1.0:1782480752.113950:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366098048 00000100:00100000:1.0:1782480752.113956:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366098048 00000100:00100000:0.0:1782480752.113956:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366097920 00000100:00100000:3.0:1782480752.114124:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366098176 00000100:00100000:3.0:1782480752.114130:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366098176 00000100:00100000:0.0:1782480752.114221:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1782480752.114232:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366097920:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480752.114337:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366097920:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 107us (1005us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480752.114347:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1782480752.118326:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:0.0:1782480752.118351:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366098048:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480752.118477:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366098048:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 137us (5229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480752.118486:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00080000:2.0:1782480752.120788:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480752.120952:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480752.120958:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480752.135532:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1782480752.135563:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366098176:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480752.135724:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366098176:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 173us (22345us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480752.135732:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00010000:00010000:3.0:1782480752.545058:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480753.567788:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388148992:0@lo:400:kworker.0 00000100:00100000:1.0:1782480753.567903:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480753.567995:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480753.568002:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388149120:0@lo:400:kworker.0 00000100:00100000:1.0:1782480753.568032:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480753.568080:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388148992 00000100:00100000:1.0:1782480753.568089:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388148992 00000100:00100000:1.0:1782480753.568159:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782480753.568170:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388148992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480753.568235:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388148992:12345-0@lo:400:kworker.0 Request processed in 66us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480753.568242:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782480753.568271:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388149120 00000100:00100000:1.0:1782480753.568275:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388149120 00000100:00100000:1.0:1782480753.568317:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782480753.568324:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388149120:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.568907:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388148736:0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.568970:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480753.569009:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388149248:0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.569036:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480753.569058:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782480753.569065:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388148864:0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.569088:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480753.569105:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388149376:0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.569130:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782480753.569165:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480753.569171:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480753.569183:0:6607:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1782480753.569194:0:6607:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:0.0:1782480753.569216:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388149248 00000100:00100000:0.0:1782480753.569222:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388149248 00000100:00100000:0.0:1782480753.569258:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388148864 00000100:00100000:0.0:1782480753.569261:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388148864 00000100:00100000:0.0:1782480753.569276:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782480753.569284:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388149248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.569709:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388149248:12345-0@lo:400:kworker.0 Request processed in 375us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480753.569736:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782480753.569756:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782480753.569763:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388148864:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.569798:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388148864:12345-0@lo:400:kworker.0 Request processed in 35us (709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480753.569804:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:0.0:1782480753.569926:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480753.570121:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388148864:0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.570135:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388149248:0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.570185:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388149376 00000100:00100000:0.0:1782480753.570189:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388149376 00000100:00100000:0.0:1782480753.570227:0:6607:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:0.0:1782480753.570236:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782480753.570241:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388149376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.570283:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388149376:12345-0@lo:400:kworker.0 Request processed in 42us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480753.570290:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:0.0:1782480753.570317:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1782480753.570338:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef6c9f80 x1869066388149376/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480753.570931:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388149120:12345-0@lo:400:kworker.0 Request processed in 2539us (2830us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480753.570958:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:1.0:1782480753.571016:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef6c8e00 x1869066388149120/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480769 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480753.571029:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388149120:0@lo:400:kworker.0 00000100:00100000:1.0:1782480753.571045:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388148992:0@lo:400:kworker.0 00000100:00100000:3.0:1782480753.571318:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388148736 00000100:00100000:3.0:1782480753.571326:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388148736 00000100:00100000:3.0:1782480753.571380:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1782480753.571389:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388148736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480753.571770:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388148736:12345-0@lo:400:kworker.0 Request processed in 382us (2798us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480753.571777:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1782480753.572116:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480753.572134:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388149504:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480753.572192:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480753.572240:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388149504 00000100:00100000:2.0:1782480753.572246:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388149504 00000100:00100000:2.0:1782480753.572283:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1782480753.572291:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388149504:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480753.572340:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480753.572390:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388149504:12345-0@lo:13:osp-pre-1-0.0 Request processed in 100us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480753.572396:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:2.0:1782480753.572782:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5adc00 x1869066388149504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480769 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480753.572802:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388149504:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480753.573075:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388149376:0@lo:400:kworker.0 00000100:00100000:0.0:1782480753.573097:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388148736:0@lo:400:kworker.0 00010000:00010000:1.0:1782480753.573202:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480754.604962:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480755.617629:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480756.133087:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388149632:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480756.133177:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480756.133279:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388149632 00000100:00100000:2.0:1782480756.133287:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388149632 00000100:00100000:2.0:1782480756.133357:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782480756.133366:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388149632:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480756.133403:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480756.133446:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388149632:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (269us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480756.133453:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1782480756.133475:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782480756.133506:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5adc00 x1869066388149632/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480772 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480756.133524:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388149632:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782480756.643275:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480757.230210:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480757.230252:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480757.230537:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366098304 00000100:00100000:3.0:1782480757.230551:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366098304 00000100:00100000:3.0:1782480757.230619:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 195 00000100:00100000:3.0:1782480757.230631:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366098304:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480757.230772:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366098304:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 143us (575us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480757.230780:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 195 00000100:00100000:1.0:1782480757.231684:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480757.231761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480757.231801:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366098432 00000100:00100000:1.0:1782480757.231810:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366098432 00000100:00100000:1.0:1782480757.231868:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:1.0:1782480757.231878:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366098432:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480757.231943:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366098432:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 67us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480757.231950:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:1.0:1782480757.231975:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366098560 00000100:00100000:1.0:1782480757.231979:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366098560 00000100:00100000:1.0:1782480757.232002:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366098688 00000100:00100000:1.0:1782480757.232005:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366098688 00000100:00100000:1.0:1782480757.232027:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1782480757.232035:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366098560:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480757.232062:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366098560:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (1809us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480757.232087:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1782480757.232100:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:1.0:1782480757.232107:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366098688:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480757.232133:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366098688:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480757.232140:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00080000:2.0:1782480757.232789:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480757.232795:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480757.232798:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782480757.667702:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782480758.344999:0:8681:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:3.0:1782480758.686956:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480758.688559:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388149760:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480758.688639:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480758.688752:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388149760 00000100:00100000:3.0:1782480758.688760:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388149760 00000100:00100000:3.0:1782480758.688833:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782480758.688843:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388149760:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480758.688879:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480758.688923:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388149760:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (284us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480758.688944:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:3.0:1782480758.688999:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5aaa00 x1869066388149760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480774 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480758.689020:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5aaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388149760:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782480758.691090:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480758.691124:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388150144:0@lo:400:kworker.0 00000100:00100000:2.0:1782480758.691200:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480758.691247:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480758.691255:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388150016:0@lo:400:kworker.0 00000100:00100000:2.0:1782480758.691321:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480758.691372:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388150144 00000100:00100000:2.0:1782480758.691380:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388150144 00000100:00100000:2.0:1782480758.691431:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388150016 00000100:00100000:2.0:1782480758.691435:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388150016 00000100:00100000:2.0:1782480758.691459:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782480758.691467:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388150144:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480758.691533:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388150144:12345-0@lo:400:kworker.0 Request processed in 67us (333us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480758.691540:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782480758.691558:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782480758.691564:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388150016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480758.691590:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388150016:12345-0@lo:400:kworker.0 Request processed in 26us (268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480758.691595:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:2.0:1782480758.691619:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480758.691647:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388150016:0@lo:400:kworker.0 00000100:00100000:2.0:1782480758.691676:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388150144:0@lo:400:kworker.0 00000100:00100000:0.0:1782480758.692750:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388149888:0@lo:400:kworker.0 00000100:00100000:0.0:1782480758.692802:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480758.692844:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388150400:0@lo:400:kworker.0 00000100:00100000:0.0:1782480758.692868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480758.692889:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480758.692896:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388150272:0@lo:400:kworker.0 00000100:00100000:0.0:1782480758.692919:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480758.692950:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388150272 00000100:00100000:0.0:1782480758.692956:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388150272 00000100:00100000:0.0:1782480758.693143:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782480758.693151:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388150272:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480758.693199:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388150272:12345-0@lo:400:kworker.0 Request processed in 49us (279us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480758.693206:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1782480758.693244:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef6cb800 x1869066388150272/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480774 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480758.693256:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388150272:0@lo:400:kworker.0 00000100:00100000:2.0:1782480758.694511:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388149888 00000100:00100000:2.0:1782480758.694523:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388149888 00000100:00100000:2.0:1782480758.694571:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1782480758.694580:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388149888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480758.694679:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388149888:12345-0@lo:400:kworker.0 Request processed in 76us (1853us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480758.694687:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00080000:2.0:1782480758.694722:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480758.694736:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388150400 00000100:00100000:2.0:1782480758.694739:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388150400 00000100:00100000:2.0:1782480758.694774:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782480758.694780:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388150400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480758.694812:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388150400:12345-0@lo:400:kworker.0 Request processed in 33us (1944us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480758.694818:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:2.0:1782480758.694834:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480758.695345:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388149888:0@lo:400:kworker.0 00000100:00100000:0.0:1782480758.696479:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388150400:0@lo:400:kworker.0 00010000:00010000:1.0:1782480759.714818:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480760.734789:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480761.265497:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480761.265517:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388150528:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480761.265583:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480761.269742:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388150528 00000100:00100000:3.0:1782480761.269759:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388150528 00000100:00080000:0.0:1782480761.269825:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480761.269963:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782480761.269974:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388150528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480761.270014:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480761.270103:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388150528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 131us (4519us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480761.270110:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:0.0:1782480761.270141:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5ace00 x1869066388150528/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480777 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480761.270165:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388150528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782480761.761202:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480762.360215:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480762.360479:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480762.360535:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366098816 00000100:00100000:3.0:1782480762.360544:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366098816 00000100:00100000:3.0:1782480762.361954:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00100000:3.0:1782480762.361982:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2352:x1869066366098816:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480762.362063:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2352:x1869066366098816:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 84us (1874us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480762.362071:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00100000:3.0:1782480762.362107:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366098944 00000100:00100000:3.0:1782480762.362129:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366098944 00000100:00100000:3.0:1782480762.362204:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:3.0:1782480762.362211:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366098944:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480762.362244:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366098944:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 34us (1775us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480762.362251:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00080000:2.0:1782480762.362985:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480762.364514:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480762.364559:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480762.364859:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366099072 00000100:00100000:2.0:1782480762.364868:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366099072 00000100:00100000:2.0:1782480762.364928:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366099200 00000100:00100000:2.0:1782480762.364932:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366099200 00000100:00100000:2.0:1782480762.364954:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1782480762.364964:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2349:x1869066366099072:12345-192.168.201.58@tcp:9:kworker.0 00000100:00080000:3.0:1782480762.365020:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480762.365024:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:2.0:1782480762.365039:0:6607:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf50b0 00000100:00080000:2.0:1782480762.365060:0:6607:0:(import.c:65:import_set_state_nolock()) ffff91d7ef6c2800 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1782480762.365096:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:2.0:1782480762.365111:0:6607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1782480762.365509:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+2:2349:x1869066366099072:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 544us (1002us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480762.365517:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1782480762.365533:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782480762.365541:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2349:x1869066366099200:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:2.0:1782480762.365555:0:6607:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf50b7 00000100:00080000:2.0:1782480762.365561:0:6607:0:(import.c:65:import_set_state_nolock()) ffff91d7ef6c3800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782480762.365579:0:6607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1782480762.365776:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+2:2349:x1869066366099200:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 235us (1215us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480762.365783:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00010000:00010000:3.0:1782480762.366455:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480762.782938:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480763.808709:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388150656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480763.808785:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1782480763.808861:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480763.808875:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388150656 00000100:00100000:3.0:1782480763.808883:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388150656 00000100:00100000:3.0:1782480763.808941:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782480763.808951:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388150656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480763.808992:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480763.809042:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388150656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 92us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480763.809050:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1782480763.809069:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1782480763.809098:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5a8380 x1869066388150656/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480779 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480763.809118:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388150656:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480763.812393:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388150784:0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.812478:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480763.812517:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388151296:0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.812543:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480763.812579:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480763.812585:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388150912:0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.812607:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480763.812634:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388151040:0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.812656:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480763.812689:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480763.812694:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388151168:0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.812718:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480763.812749:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388150784 00000100:00100000:3.0:1782480763.812756:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388150784 00000100:00100000:3.0:1782480763.812797:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1782480763.812805:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388150784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.812854:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388150784:12345-0@lo:400:kworker.0 Request processed in 49us (376us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480763.812862:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:3.0:1782480763.812898:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388151296 00000100:00100000:3.0:1782480763.812902:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388151296 00000100:00100000:3.0:1782480763.812932:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388150912 00000100:00100000:3.0:1782480763.812934:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388150912 00000100:00100000:3.0:1782480763.812945:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388151040 00000100:00100000:3.0:1782480763.812947:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388151040 00000100:00100000:3.0:1782480763.812963:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782480763.812969:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388151296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.813008:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388151296:12345-0@lo:400:kworker.0 Request processed in 39us (465us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480763.813015:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1782480763.813029:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782480763.813035:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388150912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.813058:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388150912:12345-0@lo:400:kworker.0 Request processed in 24us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480763.813063:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1782480763.813074:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782480763.813080:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388151040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.813108:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388151040:12345-0@lo:400:kworker.0 Request processed in 28us (451us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480763.813113:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1782480763.813134:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388151168 00000100:00100000:3.0:1782480763.813138:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388151168 00000100:00100000:3.0:1782480763.813164:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782480763.813170:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388151168:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.813214:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388151168:12345-0@lo:400:kworker.0 Request processed in 45us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480763.813220:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1782480763.813259:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388150912:0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.813268:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388150784:0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.813276:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388151296:0@lo:400:kworker.0 00000100:00080000:3.0:1782480763.813300:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480763.813311:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782480763.813331:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5ab100 x1869066388151168/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480779 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480763.813341:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388151168:0@lo:400:kworker.0 00000100:00100000:3.0:1782480763.813349:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388151040:0@lo:400:kworker.0 00000001:02000400:1.0:1782480764.663018:0:8925:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing yml_node 00010000:00010000:2.0:1782480764.837799:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782480765.459540:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:3.0:1782480765.459550:0:7517:0:(genops.c:906:class_export_put()) final put ffff91d7ef6c1000/227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:3.0:1782480765.459580:0:8:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ef6c1000/227f6c69-cfd7-4cc4-bae6-15b91431c78c for lustre-OST0001 00000020:00000080:3.0:1782480765.459621:0:8:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ef6c3800 for lustre-OST0001 00010000:00010000:3.0:1782480765.858351:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480766.371534:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388151424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480766.371613:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480766.381472:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388151424 00000100:00100000:1.0:1782480766.381484:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388151424 00000100:00080000:2.0:1782480766.381559:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480766.381922:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782480766.381934:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388151424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480766.381974:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480766.382063:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388151424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (10449us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480766.382071:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:1.0:1782480766.383029:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef6ca680 x1869066388151424/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480782 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480766.383062:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388151424:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1782480766.428468:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:3.0:1782480766.428478:0:6632:0:(genops.c:906:class_export_put()) final put ffff91d7ef6c4800/227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:2.0:1782480766.428595:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ef6c4800/227f6c69-cfd7-4cc4-bae6-15b91431c78c for lustre-OST0000 00000020:00000080:2.0:1782480766.428797:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ef6c2800 for lustre-OST0000 00010000:00010000:3.0:1782480766.881502:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480767.472750:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480767.472797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480767.472879:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366099328 00000100:00100000:3.0:1782480767.472890:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366099328 00000100:00100000:3.0:1782480767.472950:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 199 00000100:00100000:3.0:1782480767.472962:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366099328:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480767.473041:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366099328:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 82us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480767.473048:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 199 00000100:00100000:2.0:1782480767.473190:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366099456 00000100:00100000:2.0:1782480767.473194:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366099456 00000100:00100000:2.0:1782480767.473249:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:2.0:1782480767.473257:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366099456:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480767.473305:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366099456:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 48us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480767.473312:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00080000:3.0:1782480767.473416:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782480767.902979:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480768.926983:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480768.927128:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388151680:0@lo:400:kworker.0 00000100:00100000:1.0:1782480768.927351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480768.927432:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388152192:0@lo:400:kworker.0 00000100:00100000:1.0:1782480768.927471:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480768.927501:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782480768.927507:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388151552:0@lo:400:kworker.0 00000100:00100000:1.0:1782480768.927534:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480768.927553:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388152064:0@lo:400:kworker.0 00000100:00100000:1.0:1782480768.927572:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480768.927600:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388151936:0@lo:400:kworker.0 00000100:00100000:1.0:1782480768.927725:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480768.927743:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782480768.927749:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388151808:0@lo:400:kworker.0 00000100:00100000:1.0:1782480768.927770:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480768.928067:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388151680 00000100:00100000:3.0:1782480768.928075:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388151680 00000100:00100000:3.0:1782480768.928131:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388152064 00000100:00100000:3.0:1782480768.928135:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388152064 00000100:00100000:3.0:1782480768.928581:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388151808 00000100:00100000:3.0:1782480768.928585:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388151808 00000100:00100000:3.0:1782480768.928604:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782480768.928987:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388152320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480768.929037:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480768.929090:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388152320 00000100:00100000:2.0:1782480768.929093:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388152320 00000100:00100000:2.0:1782480768.929122:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782480768.929129:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388152320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480768.929161:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480768.929202:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5afb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388152320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 73us (164us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480768.929209:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1782480768.929247:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5ad180 x1869066388152320/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480784 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480768.929267:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388152320:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480768.929292:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782480768.929299:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388152064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480768.929349:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388152064:12345-0@lo:400:kworker.0 Request processed in 50us (1774us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480768.929355:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782480768.929369:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1782480768.929375:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388151808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480768.929415:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388151808:12345-0@lo:400:kworker.0 Request processed in 40us (1643us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480768.929420:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1782480768.929429:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388152064:0@lo:400:kworker.0 00000100:00100000:2.0:1782480768.929443:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388151808:0@lo:400:kworker.0 00000100:00100000:1.0:1782480768.929474:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388151552 00000100:00100000:1.0:1782480768.929478:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388151552 00000100:00100000:0.0:1782480768.929533:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388152192 00000100:00100000:0.0:1782480768.929538:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388152192 00000100:00100000:0.0:1782480768.929565:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388151936 00000100:00100000:0.0:1782480768.929580:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388151936 00000100:00100000:0.0:1782480768.929604:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782480768.929610:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388152192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480768.929647:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388152192:12345-0@lo:400:kworker.0 Request processed in 37us (2175us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480768.929653:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782480768.929680:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782480768.929686:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388151936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480768.929724:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388151936:12345-0@lo:400:kworker.0 Request processed in 38us (1999us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480768.929729:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1782480768.929775:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b0e00 x1869066388152192/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480768.929785:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388152192:0@lo:400:kworker.0 00000100:00080000:2.0:1782480768.935495:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480768.935512:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480768.935537:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782480768.936323:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b1f80 x1869066388151936/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480784 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480768.936343:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388151936:0@lo:400:kworker.0 00000100:00100000:1.0:1782480768.939202:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1782480768.939229:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388151552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480768.939345:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388151552:12345-0@lo:400:kworker.0 Request processed in 129us (11809us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480768.939352:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1782480768.939970:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388151680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480768.940037:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388151680:12345-0@lo:400:kworker.0 Request processed in 11423us (12685us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480768.940046:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1782480768.943549:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388151552:0@lo:400:kworker.0 00000100:00100000:0.0:1782480768.943592:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388151680:0@lo:400:kworker.0 00000001:02000400:1.0:1782480769.949053:0:9120:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.54.98 00010000:00010000:3.0:1782480769.950827:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480770.975031:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480771.487327:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480771.487351:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388152448:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480771.487426:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480771.489877:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388152448 00000100:00100000:1.0:1782480771.489892:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388152448 00000100:00100000:1.0:1782480771.489990:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1782480771.490001:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388152448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480771.490043:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480771.490155:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388152448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 156us (2729us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480771.490163:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:3.0:1782480771.490617:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782480771.490709:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef6cb800 x1869066388152448/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480787 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480771.490731:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6cb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388152448:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782480772.022890:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480772.589847:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480772.589895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480772.589965:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366099584 00000100:00100000:2.0:1782480772.589975:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366099584 00000100:00100000:2.0:1782480772.590033:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 201 00000100:00100000:2.0:1782480772.590044:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2353:x1869066366099584:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480772.590131:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2353:x1869066366099584:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 88us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480772.590138:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 201 00000100:00100000:0.0:1782480772.590909:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366099712 00000100:00100000:0.0:1782480772.590916:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366099712 00000100:00100000:0.0:1782480772.590971:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:0.0:1782480772.590980:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366099712:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480772.591030:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366099712:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 51us (1193us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480772.591045:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00080000:3.0:1782480772.591457:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1782480772.737410:0:9218:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.54.98 00010000:00010000:3.0:1782480773.086831:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480774.056098:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388152832:0@lo:400:kworker.0 00000100:00100000:2.0:1782480774.056170:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480774.057838:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388152576:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480774.057907:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480774.057960:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388152704:0@lo:400:kworker.0 00000100:00100000:0.0:1782480774.057991:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480774.059199:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388153344:0@lo:400:kworker.0 00000100:00100000:2.0:1782480774.059264:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480774.059298:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480774.059305:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388152960:0@lo:400:kworker.0 00000100:00100000:2.0:1782480774.059332:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480774.059385:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388152832 00000100:00100000:2.0:1782480774.059393:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388152832 00000100:00100000:2.0:1782480774.059435:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388152960 00000100:00100000:2.0:1782480774.059438:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388152960 00000100:00100000:2.0:1782480774.059470:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782480774.059550:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388152832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480774.059624:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388152832:12345-0@lo:400:kworker.0 Request processed in 145us (3452us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480774.059631:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782480774.059648:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1782480774.059655:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388152960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480774.059710:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388152960:12345-0@lo:400:kworker.0 Request processed in 56us (377us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480774.059716:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:2.0:1782480774.059734:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480774.059843:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388152960:0@lo:400:kworker.0 00000100:00100000:2.0:1782480774.059856:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388152832:0@lo:400:kworker.0 00000100:00100000:0.0:1782480774.060272:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388153344 00000100:00100000:0.0:1782480774.060279:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388153344 00000100:00100000:0.0:1782480774.060324:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782480774.060331:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388153344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480774.060380:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388153344:12345-0@lo:400:kworker.0 Request processed in 49us (1115us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480774.060385:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:0.0:1782480774.060404:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480774.060432:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388153088:0@lo:400:kworker.0 00000100:00100000:0.0:1782480774.060465:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480774.061617:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388153088 00000100:00100000:0.0:1782480774.061627:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388153088 00000100:00100000:0.0:1782480774.061687:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782480774.061696:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388153088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480774.061758:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388153088:12345-0@lo:400:kworker.0 Request processed in 64us (1292us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480774.061764:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:0.0:1782480774.061785:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480774.061803:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388153216:0@lo:400:kworker.0 00000100:00100000:0.0:1782480774.061850:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480774.061887:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388153216 00000100:00100000:0.0:1782480774.061891:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388153216 00000100:00100000:0.0:1782480774.061922:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782480774.061928:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388153216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480774.061963:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388153216:12345-0@lo:400:kworker.0 Request processed in 35us (113us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480774.061969:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1782480774.061986:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480774.062012:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388153216:0@lo:400:kworker.0 00010000:00080000:0.0:1782480774.062038:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef3b9180 x1869066388153088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480774.062048:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388153088:0@lo:400:kworker.0 00000100:00100000:1.0:1782480774.062797:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388152576 00000100:00100000:1.0:1782480774.062805:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388152576 00000100:00100000:1.0:1782480774.062839:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782480774.062846:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388152576:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480774.062876:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480774.062925:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388152576:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (5017us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480774.062931:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782480774.062952:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388152704 00000100:00100000:1.0:1782480774.062956:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388152704 00000100:00100000:1.0:1782480774.062980:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1782480774.062986:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388152704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480774.063022:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388152704:12345-0@lo:400:kworker.0 Request processed in 36us (5030us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480774.063028:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00010000:00080000:2.0:1782480774.063747:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c528e680 x1869066388153344/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480790 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480774.063761:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388153344:0@lo:400:kworker.0 00010000:00080000:1.0:1782480774.063856:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5ad180 x1869066388152576/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480790 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480774.063873:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388152576:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480774.066770:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388152704:0@lo:400:kworker.0 00010000:00010000:2.0:1782480774.110925:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480775.141773:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480775.896379:0:9316:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.54.98 00010000:00010000:3.0:1782480776.159045:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480776.608480:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388153472:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480776.608568:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480776.608812:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388153472 00000100:00100000:1.0:1782480776.608820:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388153472 00000100:00100000:1.0:1782480776.608887:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1782480776.608898:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388153472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480776.608950:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480776.608996:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388153472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (427us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480776.609004:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1782480776.609220:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef6ca300 x1869066388153472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480792 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782480776.609364:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480776.614618:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388153472:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1782480777.187119:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480777.712566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480777.712613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480777.712705:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366099968 00000100:00100000:2.0:1782480777.712715:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366099968 00000100:00100000:2.0:1782480777.712798:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:2.0:1782480777.712809:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366099968:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:0.0:1782480777.712877:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480777.712888:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366099968:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 81us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480777.712896:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:1.0:1782480777.713197:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366099840 00000100:00100000:1.0:1782480777.713202:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366099840 00000100:00100000:1.0:1782480777.713240:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 203 00000100:00100000:1.0:1782480777.713248:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366099840:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480777.713292:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366099840:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 45us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480777.713299:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 203 00000001:02000400:2.0:1782480778.064102:0:9364:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Jun 26 09:32:56 EDT 2026 00010000:00010000:0.0:1782480778.206835:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480779.168004:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388153600:0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168086:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480779.168151:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388154112:0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168183:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480779.168216:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1782480779.168222:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388153728:0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168258:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480779.168274:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388154240:0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168298:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480779.168327:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388153984:0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168349:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480779.168381:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480779.168387:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388153856:0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168409:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480779.168441:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388154112 00000100:00100000:2.0:1782480779.168448:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388154112 00000100:00100000:2.0:1782480779.168504:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388153728 00000100:00100000:2.0:1782480779.168508:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388153728 00000100:00100000:2.0:1782480779.168522:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388153856 00000100:00100000:2.0:1782480779.168524:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388153856 00000100:00100000:2.0:1782480779.168552:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782480779.168559:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388154112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168620:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388154112:12345-0@lo:400:kworker.0 Request processed in 61us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480779.168627:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782480779.168642:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782480779.168648:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388153728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168706:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388153728:12345-0@lo:400:kworker.0 Request processed in 58us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480779.168713:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782480779.168724:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782480779.168730:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388153856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168761:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388153856:12345-0@lo:400:kworker.0 Request processed in 31us (351us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480779.168766:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1782480779.168785:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388154240 00000100:00100000:2.0:1782480779.168789:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388154240 00000100:00100000:2.0:1782480779.168811:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388153984 00000100:00100000:2.0:1782480779.168813:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388153984 00000100:00100000:2.0:1782480779.168829:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782480779.168834:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388154240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168861:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388154240:12345-0@lo:400:kworker.0 Request processed in 27us (562us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480779.168866:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782480779.168876:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782480779.168881:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388153984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.168915:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388153984:12345-0@lo:400:kworker.0 Request processed in 33us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480779.168921:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1782480779.168942:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480779.168945:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480779.168947:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480779.168980:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388153856:0@lo:400:kworker.0 00010000:00080000:2.0:1782480779.168991:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df9f2300 x1869066388153984/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480779.169000:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388153984:0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.169029:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388153728:0@lo:400:kworker.0 00010000:00080000:2.0:1782480779.169040:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df9f3800 x1869066388154240/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480795 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480779.169049:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388154240:0@lo:400:kworker.0 00000100:00100000:2.0:1782480779.169059:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388154112:0@lo:400:kworker.0 00000100:00100000:0.0:1782480779.169495:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388153600 00000100:00100000:0.0:1782480779.169501:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388153600 00000100:00100000:0.0:1782480779.169543:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:0.0:1782480779.169549:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388153600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480779.169605:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388153600:12345-0@lo:400:kworker.0 Request processed in 56us (1519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480779.169612:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1782480779.170212:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388153600:0@lo:400:kworker.0 00000100:00100000:0.0:1782480779.175325:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480779.181513:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388154368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480779.181611:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480779.182770:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388154368 00000100:00100000:1.0:1782480779.182783:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388154368 00000100:00100000:1.0:1782480779.182848:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1782480779.182858:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388154368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480779.182897:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480779.182953:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388154368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1342us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480779.182961:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1782480779.183006:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c528ce00 x1869066388154368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480795 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480779.183026:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388154368:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480779.230827:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480780.259020:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480781.278983:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480781.733179:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388154496:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480781.733250:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480781.733413:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388154496 00000100:00100000:1.0:1782480781.733421:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388154496 00000100:00100000:1.0:1782480781.733480:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782480781.733489:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388154496:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480781.733535:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782480781.737280:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480781.739403:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388154496:12345-0@lo:13:osp-pre-0-0.0 Request processed in 5907us (6145us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480781.739418:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:3.0:1782480781.743825:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef6c9880 x1869066388154496/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480797 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480781.744081:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388154496:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782480782.302830:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480782.826475:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480782.826524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480782.826747:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366100096 00000100:00100000:1.0:1782480782.826759:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366100096 00000100:00100000:1.0:1782480782.826825:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 205 00000100:00100000:1.0:1782480782.826837:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2352:x1869066366100096:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480782.826934:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2352:x1869066366100096:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 100us (468us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480782.826942:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 205 00000100:00100000:2.0:1782480782.831264:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366100224 00000100:00100000:2.0:1782480782.831278:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366100224 00000100:00080000:0.0:1782480782.831392:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480782.831395:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:2.0:1782480782.831408:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366100224:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480782.831510:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366100224:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 105us (4984us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480782.831534:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00010000:00010000:2.0:1782480783.335215:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480784.289155:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388154624:0@lo:400:kworker.0 00000100:00100000:0.0:1782480784.289282:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480784.289420:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388154624 00000100:00100000:0.0:1782480784.289439:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388154624 00000100:00100000:0.0:1782480784.289503:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1782480784.289512:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388154624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480784.289598:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388154624:12345-0@lo:400:kworker.0 Request processed in 74us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480784.289605:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1782480784.289684:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388154624:0@lo:400:kworker.0 00000100:00100000:1.0:1782480784.294214:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388154752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480784.294305:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480784.294382:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388154752 00000100:00100000:3.0:1782480784.294390:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388154752 00000100:00100000:3.0:1782480784.294457:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782480784.294467:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388154752:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480784.294508:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480784.294621:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388154880:0@lo:400:kworker.0 00000100:00100000:0.0:1782480784.294696:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480784.294721:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480784.294727:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388155008:0@lo:400:kworker.0 00000100:00100000:0.0:1782480784.294750:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480784.294775:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388155136:0@lo:400:kworker.0 00000100:00100000:0.0:1782480784.294835:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480784.294889:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388154880 00000100:00100000:0.0:1782480784.294893:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388154880 00000100:00100000:0.0:1782480784.294940:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388155008 00000100:00100000:0.0:1782480784.294944:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388155008 00000100:00100000:0.0:1782480784.294998:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782480784.295004:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388154880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480784.295066:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388154880:12345-0@lo:400:kworker.0 Request processed in 62us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480784.295087:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782480784.295103:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782480784.295127:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388155008:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480784.295153:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388155008:12345-0@lo:400:kworker.0 Request processed in 29us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480784.295158:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782480784.295179:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388155136 00000100:00100000:0.0:1782480784.295182:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388155136 00000100:00100000:0.0:1782480784.295208:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480784.295214:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388155136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480784.295245:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388155136:12345-0@lo:400:kworker.0 Request processed in 31us (409us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480784.295250:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480784.295290:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388155008:0@lo:400:kworker.0 00000100:00100000:0.0:1782480784.295300:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388154880:0@lo:400:kworker.0 00010000:00080000:0.0:1782480784.295331:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c528f100 x1869066388155136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480800 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480784.295341:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388155136:0@lo:400:kworker.0 00000100:00100000:1.0:1782480784.296156:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388155264:0@lo:400:kworker.0 00000100:00100000:1.0:1782480784.296192:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480784.298162:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388155264 00000100:00100000:0.0:1782480784.298175:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388155264 00000100:00100000:0.0:1782480784.298226:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1782480784.298247:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388155264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480784.298315:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388155264:12345-0@lo:400:kworker.0 Request processed in 70us (2123us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480784.298321:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782480784.298432:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388154752:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3965us (4125us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480784.298440:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:3.0:1782480784.298462:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480784.298467:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480784.298469:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1782480784.299250:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df9f3b80 x1869066388154752/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480800 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480784.299272:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388154752:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480784.299300:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388155264:0@lo:400:kworker.0 00010000:00010000:2.0:1782480784.365471:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480785.382987:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480786.402044:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480786.846768:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1782480786.846788:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388155392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480786.846848:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480786.846931:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388155392 00000100:00100000:3.0:1782480786.846938:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388155392 00000100:00100000:3.0:1782480786.847006:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782480786.847014:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388155392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480786.847051:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480786.847136:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388155392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (286us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480786.847149:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:3.0:1782480786.847172:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782480786.847392:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b0e00 x1869066388155392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480802 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480786.847413:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388155392:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782480787.425578:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480787.959424:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480787.959471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480787.959500:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366100480 00000100:00100000:0.0:1782480787.959510:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366100480 00000100:00100000:0.0:1782480787.959583:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:0.0:1782480787.959593:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366100480:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480787.959738:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366100352 00000100:00100000:2.0:1782480787.959742:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366100352 00000100:00100000:2.0:1782480787.959772:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 207 00000100:00100000:2.0:1782480787.959780:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2352:x1869066366100352:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480787.959835:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2352:x1869066366100352:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 55us (419us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480787.959842:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 207 00000100:00100000:0.0:1782480787.960125:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366100480:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 534us (652us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480787.960132:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00080000:0.0:1782480787.960151:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782480788.447427:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480789.408497:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388155520:0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.408567:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480789.408611:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388156032:0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.408636:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480789.408681:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480789.408687:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388155904:0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.408723:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480789.408753:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388155648:0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.408778:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480789.409315:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388156160:0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.409343:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480789.409363:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480789.409369:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388155776:0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.409401:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480789.409489:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388155520 00000100:00100000:2.0:1782480789.409496:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388155520 00000100:00100000:2.0:1782480789.409539:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1782480789.409547:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388155520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.409598:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388155520:12345-0@lo:400:kworker.0 Request processed in 51us (1030us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480789.409605:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 208 00000100:00100000:2.0:1782480789.409641:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388156032 00000100:00100000:2.0:1782480789.409645:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388156032 00000100:00100000:2.0:1782480789.410639:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388155648 00000100:00100000:2.0:1782480789.410648:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388155648 00000100:00100000:1.0:1782480789.411138:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388155776 00000100:00100000:1.0:1782480789.411154:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388155776 00000100:00100000:1.0:1782480789.411190:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782480789.411200:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388156032:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480789.411267:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388156032:12345-0@lo:400:kworker.0 Request processed in 68us (2629us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480789.411274:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782480789.411290:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782480789.411296:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388155648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480789.411332:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388155648:12345-0@lo:400:kworker.0 Request processed in 36us (2553us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480789.411337:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782480789.411349:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782480789.411356:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388155776:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480789.411395:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388155776:12345-0@lo:400:kworker.0 Request processed in 41us (1993us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480789.411400:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782480789.411442:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388155776:0@lo:400:kworker.0 00000100:00100000:1.0:1782480789.411456:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388155648:0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.411893:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388155904 00000100:00100000:2.0:1782480789.411898:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388155904 00000100:00100000:2.0:1782480789.411933:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388156160 00000100:00100000:2.0:1782480789.411936:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388156160 00000100:00100000:2.0:1782480789.411969:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782480789.411976:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388155904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.412014:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388155904:12345-0@lo:400:kworker.0 Request processed in 39us (3289us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480789.412020:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782480789.412032:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782480789.412038:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388156160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.412068:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388156160:12345-0@lo:400:kworker.0 Request processed in 31us (2725us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480789.412073:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:2.0:1782480789.412105:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480789.412108:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480789.412118:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1782480789.412145:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c528f100 x1869066388155904/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480789.412157:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388155904:0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.412166:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388155520:0@lo:400:kworker.0 00000100:00100000:2.0:1782480789.412176:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388156032:0@lo:400:kworker.0 00010000:00080000:1.0:1782480789.413580:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c528f480 x1869066388156160/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480805 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480789.413594:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388156160:0@lo:400:kworker.0 00000100:00100000:1.0:1782480789.414131:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480789.414145:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388156288:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480789.414199:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480789.416007:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388156288 00000100:00100000:3.0:1782480789.416024:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388156288 00000100:00100000:3.0:1782480789.416083:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782480789.416093:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388156288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480789.416130:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480789.416195:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388156288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (1995us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480789.416202:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:1.0:1782480789.416828:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef6c9500 x1869066388156288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480805 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480789.416849:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388156288:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480789.474175:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480790.495401:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480791.519148:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480791.967679:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388156416:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480791.967749:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480791.968813:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388156416 00000100:00100000:3.0:1782480791.968823:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388156416 00000100:00100000:3.0:1782480791.969264:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1782480791.969275:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388156416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480791.969313:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480791.969380:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388156416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (1630us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480791.969386:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1782480791.970601:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782480791.970648:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5aca80 x1869066388156416/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480807 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480791.970703:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388156416:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1782480792.544789:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480793.069214:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480793.069261:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480793.069384:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366100608 00000100:00100000:2.0:1782480793.069394:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366100608 00000100:00100000:2.0:1782480793.069455:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:2.0:1782480793.069465:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366100608:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480793.069543:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366100608:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 79us (339us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480793.069550:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:3.0:1782480793.073790:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366100736 00000100:00100000:3.0:1782480793.073805:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366100736 00000100:00100000:3.0:1782480793.073882:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:3.0:1782480793.073904:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366100736:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:2.0:1782480793.073919:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480793.073999:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366100736:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 97us (4736us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480793.074008:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00010000:00010000:2.0:1782480793.571644:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480794.526978:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388156800:0@lo:400:kworker.0 00000100:00100000:0.0:1782480794.527050:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480794.527113:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1782480794.527119:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388156672:0@lo:400:kworker.0 00000100:00100000:0.0:1782480794.527142:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480794.527170:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388157184:0@lo:400:kworker.0 00000100:00100000:0.0:1782480794.527194:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480794.527247:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388156800 00000100:00100000:0.0:1782480794.527253:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388156800 00000100:00100000:0.0:1782480794.527303:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388156672 00000100:00100000:0.0:1782480794.527306:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388156672 00000100:00100000:0.0:1782480794.527329:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782480794.527337:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388156800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480794.527388:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388156800:12345-0@lo:400:kworker.0 Request processed in 51us (338us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480794.527396:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782480794.527413:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782480794.527418:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388156672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480794.527444:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388156672:12345-0@lo:400:kworker.0 Request processed in 26us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480794.527449:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1782480794.527470:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388157184 00000100:00100000:0.0:1782480794.527473:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388157184 00000100:00100000:0.0:1782480794.527503:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782480794.527510:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388157184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480794.527540:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388157184:12345-0@lo:400:kworker.0 Request processed in 31us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480794.527546:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1782480794.527561:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480794.527565:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480794.527610:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388156928:0@lo:400:kworker.0 00000100:00100000:0.0:1782480794.527615:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388156672:0@lo:400:kworker.0 00010000:00080000:0.0:1782480794.527631:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df9f3800 x1869066388157184/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480794.527641:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388157184:0@lo:400:kworker.0 00000100:00100000:1.0:1782480794.527647:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480794.527688:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388156800:0@lo:400:kworker.0 00000100:00100000:1.0:1782480794.527700:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1782480794.527718:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388156544:0@lo:400:kworker.0 00000100:00100000:0.0:1782480794.527752:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388157312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480794.527767:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480794.527782:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480794.527810:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388157312 00000100:00100000:0.0:1782480794.527814:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388157312 00000100:00100000:0.0:1782480794.527836:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782480794.527843:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388157312:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480794.527879:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480794.527911:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388157312:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (129us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480794.527917:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:0.0:1782480794.527941:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df9f3b80 x1869066388157312/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480810 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480794.527953:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388157312:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480794.528109:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388157056:0@lo:400:kworker.0 00000100:00100000:1.0:1782480794.528136:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480794.528266:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388156928 00000100:00100000:2.0:1782480794.528270:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388156928 00000100:00100000:2.0:1782480794.528322:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782480794.528329:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388156928:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480794.528372:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388156928:12345-0@lo:400:kworker.0 Request processed in 45us (726us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480794.528378:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782480794.528397:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388156544 00000100:00100000:2.0:1782480794.528400:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388156544 00000100:00100000:2.0:1782480794.528421:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1782480794.528427:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388156544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480794.528453:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388156544:12345-0@lo:400:kworker.0 Request processed in 27us (700us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480794.528458:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 210 00000100:00100000:2.0:1782480794.528494:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388156544:0@lo:400:kworker.0 00010000:00080000:2.0:1782480794.528504:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df9f1c00 x1869066388156928/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480810 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480794.528512:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388156928:0@lo:400:kworker.0 00000100:00080000:1.0:1782480794.528588:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480794.529091:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388157056 00000100:00100000:0.0:1782480794.529095:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388157056 00000100:00100000:0.0:1782480794.529189:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782480794.529198:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388157056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480794.529243:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388157056:12345-0@lo:400:kworker.0 Request processed in 47us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480794.529249:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1782480794.529277:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388157056:0@lo:400:kworker.0 00000100:00080000:2.0:1782480794.532930:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782480794.590874:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480795.614968:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480796.639943:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782480796.655103:0:9994:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 09:33:14 (1782480794) === 00000100:00100000:0.0:1782480797.067526:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480797.067630:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366100864 00000100:00100000:2.0:1782480797.067641:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366100864 00000100:00100000:2.0:1782480797.067736:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:2.0:1782480797.067746:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:8095:x1869066366100864:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782480797.067764:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480797.067781:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d802058a00/0x4776e02a9acf517b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fbb2 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480797.067841:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d802058a00/0x4776e02a9acf517b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbb2 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480797.067852:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d802058a00/0x4776e02a9acf517b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbb2 expref: 11 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480797.067862:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d802058a00, rc 0) 00000100:00100000:2.0:1782480797.067924:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:8095:x1869066366100864:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 180us (408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480797.067932:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:2.0:1782480797.080290:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480797.080402:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366100992 00000100:00100000:0.0:1782480797.080412:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366100992 00000100:00100000:0.0:1782480797.080468:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:0.0:1782480797.080479:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:8095:x1869066366100992:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782480797.080850:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:8095:x1869066366100992:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 371us (569us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.080859:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:2.0:1782480797.087155:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388157440:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480797.087241:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480797.087404:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388157440 00000100:00100000:3.0:1782480797.087413:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388157440 00000100:00100000:3.0:1782480797.087604:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782480797.087615:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388157440:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480797.088007:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480797.088074:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388157440:12345-0@lo:13:osp-pre-0-0.0 Request processed in 461us (832us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480797.088082:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1782480797.088571:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00080000:2.0:1782480797.088948:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782480797.088989:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b1180 x1869066388157440/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480813 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480797.089010:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388157440:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480797.090130:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366101120 00000100:00100000:0.0:1782480797.090142:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366101120 00000100:00100000:0.0:1782480797.090186:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:0.0:1782480797.090194:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:8095:x1869066366101120:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782480797.090397:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:8095:x1869066366101120:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 203us (1828us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.090404:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:3.0:1782480797.096336:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480797.096732:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366101248 00000100:00100000:0.0:1782480797.096742:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366101248 00000100:00100000:0.0:1782480797.096794:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 214 00000100:00100000:0.0:1782480797.096804:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:8099:x1869066366101248:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480797.097099:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:8099:x1869066366101248:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 295us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.097108:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 214 00000100:00100000:0.0:1782480797.125060:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480797.127054:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366101376 00000100:00100000:2.0:1782480797.127069:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366101376 00000100:00100000:2.0:1782480797.127143:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00100000:2.0:1782480797.127154:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:8099:x1869066366101376:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782480797.127578:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:8099:x1869066366101376:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 425us (2527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480797.127587:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00100000:3.0:1782480797.136272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480797.136362:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366101504 00000100:00100000:0.0:1782480797.136376:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366101504 00000100:00100000:0.0:1782480797.136422:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:0.0:1782480797.136441:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:8095:x1869066366101504:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782480797.136457:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480797.136471:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297ae00/0x4776e02a9acf5182 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fbdc expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480797.136494:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297ae00/0x4776e02a9acf5182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbdc expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480797.136501:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297ae00/0x4776e02a9acf5182 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbdc expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480797.136507:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297ae00, rc 0) 00000100:00100000:0.0:1782480797.136558:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:8095:x1869066366101504:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 118us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.136563:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:3.0:1782480797.143432:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480797.143599:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366101632 00000100:00100000:2.0:1782480797.143609:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366101632 00000100:00100000:0.0:1782480797.144514:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:0.0:1782480797.144531:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:8095:x1869066366101632:12345-192.168.201.58@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782480797.144567:0:5797:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782480797.144589:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782480797.144593:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782480797.144595:0:5797:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782480797.144598:0:5797:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1782480797.158054:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:8095:x1869066366101632:12345-192.168.201.58@tcp:256:mount.lustre.0 Request processed in 13517us (14620us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.158070:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:1.0:1782480797.161984:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480797.162448:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366101760 00000100:00100000:2.0:1782480797.162457:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366101760 00000100:00100000:2.0:1782480797.162503:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:2.0:1782480797.162510:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:8095:x1869066366101760:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782480797.162524:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480797.162540:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d802059400/0x4776e02a9acf5189 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fbe3 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480797.162562:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d802059400/0x4776e02a9acf5189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbe3 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480797.162570:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d802059400/0x4776e02a9acf5189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbe3 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480797.162577:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d802059400, rc 0) 00000100:00100000:2.0:1782480797.162626:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:8095:x1869066366101760:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 117us (651us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480797.162630:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:3.0:1782480797.166464:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480797.166576:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366101888 00000100:00100000:0.0:1782480797.166587:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366101888 00000100:00100000:0.0:1782480797.167102:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:0.0:1782480797.167115:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:8095:x1869066366101888:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782480797.167420:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:8095:x1869066366101888:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 308us (965us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.167429:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:1.0:1782480797.170277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480797.170346:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366102016 00000100:00100000:3.0:1782480797.170354:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366102016 00000100:00100000:3.0:1782480797.170405:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:3.0:1782480797.170412:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:8095:x1869066366102016:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782480797.170622:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:8095:x1869066366102016:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 209us (350us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480797.170628:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:1.0:1782480797.174073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480797.174191:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366102144 00000100:00100000:0.0:1782480797.174201:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366102144 00000100:00100000:0.0:1782480797.174293:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 221 00000100:00100000:0.0:1782480797.174304:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:8103:x1869066366102144:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480797.174572:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:8103:x1869066366102144:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 269us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.174581:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 221 00000100:00100000:1.0:1782480797.181598:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480797.181686:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366102272 00000100:00100000:2.0:1782480797.181696:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366102272 00000100:00100000:2.0:1782480797.181747:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00100000:2.0:1782480797.181756:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:8103:x1869066366102272:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782480797.182000:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:8103:x1869066366102272:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 244us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480797.182009:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00100000:1.0:1782480797.200398:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480797.200440:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480797.200531:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366102400 00000100:00100000:3.0:1782480797.200541:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366102400 00000100:00100000:3.0:1782480797.200600:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366102784 00000100:00100000:3.0:1782480797.200604:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366102784 00000100:00100000:3.0:1782480797.200706:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:3.0:1782480797.200717:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366102784:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480797.200799:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366102784:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 83us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480797.200807:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:3.0:1782480797.200838:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1782480797.200843:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2349:x1869066366102400:12345-192.168.201.58@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782480797.200877:0:6840:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from da13206b-be2f-48d4-ba4f-8aa0d1f46dad@192.168.201.58@tcp t0 exp 0000000000000000 cur 327 last 0 00000020:00000080:3.0:1782480797.200914:0:6840:0:(genops.c:1406:class_connect()) connect: client da13206b-be2f-48d4-ba4f-8aa0d1f46dad, cookie 0x4776e02a9acf5190 00000004:00100000:3.0:1782480797.200949:0:6840:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1782480797.201249:0:6840:0:(import.c:65:import_set_state_nolock()) ffff91d7ed068800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782480797.201285:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2349:x1869066366102400:12345-192.168.201.58@tcp:38:mount.lustre.0 Request processed in 441us (898us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480797.201292:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00080000:1.0:1782480797.202616:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480797.207768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480797.207822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480797.208015:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366102656 00000100:00100000:0.0:1782480797.208027:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366102656 00000100:00100000:0.0:1782480797.208099:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366102528 00000100:00100000:0.0:1782480797.208103:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366102528 00000100:00100000:0.0:1782480797.208127:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:0.0:1782480797.208137:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+7:8095:x1869066366102656:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782480797.208180:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782480797.208263:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+7:8095:x1869066366102656:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 127us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.208272:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:0.0:1782480797.208291:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:0.0:1782480797.208297:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:0:x1869066366102528:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:0.0:1782480797.208309:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1782480797.208348:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:0:x1869066366102528:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 51us (534us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.208355:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00080000:1.0:1782480797.208961:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480797.211725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480797.212161:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366102912 00000100:00100000:0.0:1782480797.212171:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366102912 00000100:00100000:0.0:1782480797.212237:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1782480797.212247:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:8095:x1869066366102912:12345-192.168.201.58@tcp:40:mount.lustre.0 00000100:00100000:0.0:1782480797.212345:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:8095:x1869066366102912:12345-192.168.201.58@tcp:40:mount.lustre.0 Request processed in 98us (629us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.212353:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1782480797.216031:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480797.216088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480797.216403:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366103040 00000100:00100000:2.0:1782480797.216427:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366103040 00000100:00100000:2.0:1782480797.216471:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366103168 00000100:00100000:2.0:1782480797.216474:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366103168 00000100:00100000:2.0:1782480797.216502:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1782480797.216511:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1869066366103040:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782480797.216546:0:6607:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from da13206b-be2f-48d4-ba4f-8aa0d1f46dad@192.168.201.58@tcp t0 exp 0000000000000000 cur 327 last 0 00000100:00100000:3.0:1782480797.216579:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000020:00000080:2.0:1782480797.216581:0:6607:0:(genops.c:1406:class_connect()) connect: client da13206b-be2f-48d4-ba4f-8aa0d1f46dad, cookie 0x4776e02a9acf5197 00000100:00100000:3.0:1782480797.216585:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1869066366103168:12345-192.168.201.58@tcp:8:mount.lustre.0 00002000:00100000:2.0:1782480797.216592:0:6607:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli da13206b-be2f-48d4-ba4f-8aa0d1f46dad/ffff91d7c4a88800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00010000:00080000:3.0:1782480797.216598:0:6609:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from da13206b-be2f-48d4-ba4f-8aa0d1f46dad@192.168.201.58@tcp t0 exp 0000000000000000 cur 327 last 0 00002000:00100000:2.0:1782480797.216603:0:6607:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000020:00000080:3.0:1782480797.216617:0:6609:0:(genops.c:1406:class_connect()) connect: client da13206b-be2f-48d4-ba4f-8aa0d1f46dad, cookie 0x4776e02a9acf519e 00002000:00100000:3.0:1782480797.216622:0:6609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli da13206b-be2f-48d4-ba4f-8aa0d1f46dad/ffff91d7ed06a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782480797.216639:0:6609:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782480797.216869:0:6609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00002000:00080000:2.0:1782480797.216869:0:6607:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782480797.216907:0:6609:0:(import.c:65:import_set_state_nolock()) ffff91d7ed06e000 : changing import state from RECOVER to FULL 00000100:00080000:2.0:1782480797.219493:0:6607:0:(import.c:65:import_set_state_nolock()) ffff91d7c4a8c800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480797.219588:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2349:x1869066366103040:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 3072us (3564us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480797.219599:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:0.0:1782480797.224506:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2349:x1869066366103168:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 7905us (8402us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.224521:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1782480797.224842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480797.227027:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366103296 00000100:00100000:1.0:1782480797.227042:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366103296 00000100:00100000:1.0:1782480797.227130:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:1.0:1782480797.227141:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:8095:x1869066366103296:12345-192.168.201.58@tcp:33:mount.lustre.0 00000004:00200000:1.0:1782480797.227507:0:5805:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:0.0:1782480797.229393:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:8095:x1869066366103296:12345-192.168.201.58@tcp:33:mount.lustre.0 Request processed in 2240us (4538us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480797.229413:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00010000:00010000:0.0:1782480797.662980:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480798.688854:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480799.648080:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388157568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480799.648264:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388157696:0@lo:400:kworker.0 00000100:00100000:1.0:1782480799.648320:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480799.648367:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388158208:0@lo:400:kworker.0 00000100:00100000:1.0:1782480799.648392:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480799.648415:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782480799.648421:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388157824:0@lo:400:kworker.0 00000100:00100000:1.0:1782480799.648442:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480799.648457:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388158336:0@lo:400:kworker.0 00000100:00100000:1.0:1782480799.648478:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480799.648505:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388158208 00000100:00100000:1.0:1782480799.648512:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388158208 00000100:00100000:1.0:1782480799.648564:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388157824 00000100:00100000:1.0:1782480799.648567:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388157824 00000100:00100000:1.0:1782480799.648592:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782480799.648601:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388158208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480799.648735:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388158208:12345-0@lo:400:kworker.0 Request processed in 135us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480799.648743:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1782480799.648762:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782480799.648768:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388157824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480799.648808:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388157824:12345-0@lo:400:kworker.0 Request processed in 40us (365us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480799.648815:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782480799.648848:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388158336 00000100:00100000:1.0:1782480799.648852:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388158336 00000100:00100000:1.0:1782480799.648882:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1782480799.648889:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388158336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480799.648922:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388158336:12345-0@lo:400:kworker.0 Request processed in 34us (442us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480799.648928:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:1.0:1782480799.648956:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480799.648960:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480799.648997:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388157824:0@lo:400:kworker.0 00010000:00080000:1.0:1782480799.649011:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5dca80 x1869066388158336/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480799.649021:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388158336:0@lo:400:kworker.0 00000100:00100000:1.0:1782480799.649030:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388158208:0@lo:400:kworker.0 00000100:00100000:2.0:1782480799.649242:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480799.649278:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388158080:0@lo:400:kworker.0 00000100:00100000:2.0:1782480799.649302:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480799.649320:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480799.649326:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388157952:0@lo:400:kworker.0 00000100:00100000:2.0:1782480799.649346:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480799.649371:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388157696 00000100:00100000:2.0:1782480799.649375:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388157696 00000100:00100000:2.0:1782480799.649402:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1782480799.649408:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388157696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480799.649442:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388157696:12345-0@lo:400:kworker.0 Request processed in 34us (1121us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480799.649455:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1782480799.649485:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388157952 00000100:00100000:2.0:1782480799.649488:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388157952 00000100:00100000:2.0:1782480799.649514:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782480799.649519:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388157952:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480799.649551:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388157952:12345-0@lo:400:kworker.0 Request processed in 31us (203us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480799.649556:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782480799.649576:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388158080 00000100:00100000:2.0:1782480799.649579:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388158080 00000100:00100000:2.0:1782480799.649609:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782480799.649616:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388158080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480799.649645:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388158080:12345-0@lo:400:kworker.0 Request processed in 30us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480799.649651:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1782480799.649694:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480799.649697:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480799.649714:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388157696:0@lo:400:kworker.0 00000100:00100000:2.0:1782480799.649735:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388157952:0@lo:400:kworker.0 00010000:00080000:2.0:1782480799.649745:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5df800 x1869066388158080/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480815 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480799.649753:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5df800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388158080:0@lo:400:kworker.0 00000100:00100000:1.0:1782480799.649892:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388157568 00000100:00100000:1.0:1782480799.649897:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388157568 00000100:00100000:1.0:1782480799.649932:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1782480799.649939:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388157568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480799.650073:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00010000:00080000:2.0:1782480799.650225:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df9f1c00 x1869066388157568/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480815 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480799.650242:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388157568:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480799.650292:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388157568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 353us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480799.650299:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00010000:0.0:1782480799.710993:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480800.737163:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782480801.244961:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da13206b-be2f-48d4-ba4f-8aa0d1f46dad 00010000:00010000:1.0:1782480801.759315:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480802.211207:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480802.211236:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388158464:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480802.211310:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480802.213967:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388158464 00000100:00100000:2.0:1782480802.213981:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388158464 00000100:00100000:2.0:1782480802.214041:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782480802.214052:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388158464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480802.214085:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480802.214167:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388158464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 117us (2855us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480802.214174:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00080000:2.0:1782480802.214203:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1782480802.214293:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b0e00 x1869066388158464/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480818 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480802.214312:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388158464:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480802.288532:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480802.288577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480802.288604:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480802.288628:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480802.288685:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480802.288718:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366103936 00000100:00100000:0.0:1782480802.288744:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366103936 00000100:00100000:0.0:1782480802.288803:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366103808 00000100:00100000:0.0:1782480802.288806:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366103808 00000100:00100000:0.0:1782480802.288831:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:0.0:1782480802.288844:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366103936:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480802.288935:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366103936:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 93us (329us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480802.288943:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:0.0:1782480802.288962:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:0.0:1782480802.288969:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2352:x1869066366103808:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480802.288995:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2352:x1869066366103808:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480802.289002:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:1.0:1782480802.289198:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366103424 00000100:00100000:1.0:1782480802.289202:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366103424 00000100:00100000:1.0:1782480802.289239:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:1.0:1782480802.289246:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366103424:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480802.289275:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366103424:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 29us (755us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480802.289281:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 224 00000001:00100000:3.0:1782480802.291875:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da13206b-be2f-48d4-ba4f-8aa0d1f46dad 00000100:00100000:2.0:1782480802.293894:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366103680 00000100:00100000:2.0:1782480802.293908:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366103680 00000100:00100000:2.0:1782480802.293969:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366103552 00000100:00100000:2.0:1782480802.293972:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366103552 00000100:00100000:3.0:1782480802.293991:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:3.0:1782480802.294013:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2352:x1869066366103680:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480802.294093:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2352:x1869066366103680:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 93us (5515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480802.294220:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:2.0:1782480802.294230:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366103552:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480802.294259:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366103552:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 32us (5630us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480802.294265:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00080000:2.0:1782480802.294307:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782480802.294311:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480802.294325:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480802.298503:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00000001:00100000:2.0:1782480802.310417:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da13206b-be2f-48d4-ba4f-8aa0d1f46dad 00010000:00010000:0.0:1782480802.782982:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782480803.571464:0:10190:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1782480803.806878:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480804.766835:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388158592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480804.766923:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480804.767002:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388158592 00000100:00100000:2.0:1782480804.767010:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388158592 00000100:00100000:2.0:1782480804.767069:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782480804.767080:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388158592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480804.767125:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480804.767175:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388158592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (252us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480804.767182:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:2.0:1782480804.767203:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782480804.767234:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5de680 x1869066388158592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480820 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480804.767253:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5de680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388158592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480804.768071:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388158720:0@lo:400:kworker.0 00000100:00100000:3.0:1782480804.768082:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388158848:0@lo:400:kworker.0 00000100:00100000:2.0:1782480804.768116:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480804.768117:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480804.768149:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388159232:0@lo:400:kworker.0 00000100:00100000:3.0:1782480804.768160:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388158848 00000100:00100000:3.0:1782480804.768165:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388158848 00000100:00100000:2.0:1782480804.768171:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480804.768197:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388159232 00000100:00100000:2.0:1782480804.768197:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388158720 00000100:00100000:3.0:1782480804.768200:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388159232 00000100:00100000:2.0:1782480804.768200:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388158720 00000100:00100000:3.0:1782480804.768224:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782480804.768224:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:3.0:1782480804.768231:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388158848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480804.768231:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388158720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480804.776539:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388158848:12345-0@lo:400:kworker.0 Request processed in 8297us (8409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480804.776554:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:3.0:1782480804.776597:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782480804.776613:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388159232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480804.776712:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388159232:12345-0@lo:400:kworker.0 Request processed in 107us (8539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480804.776718:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1782480804.776758:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388158976:0@lo:400:kworker.0 00000100:00100000:3.0:1782480804.776814:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480804.776848:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480804.776855:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388159104:0@lo:400:kworker.0 00000100:00100000:3.0:1782480804.776879:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480804.776914:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388159104 00000100:00100000:3.0:1782480804.776922:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388159104 00000100:00100000:3.0:1782480804.776964:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1782480804.776970:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388159104:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480804.777000:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388159104:12345-0@lo:400:kworker.0 Request processed in 32us (121us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480804.777013:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1782480804.777033:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480804.777038:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480804.777070:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388158848:0@lo:400:kworker.0 00010000:00080000:3.0:1782480804.777101:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5ab100 x1869066388159104/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480820 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480804.777112:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388159104:0@lo:400:kworker.0 00000100:00100000:2.0:1782480804.777602:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388158720:12345-0@lo:400:kworker.0 Request processed in 9368us (9483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480804.777625:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1782480804.777692:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388158976 00000100:00100000:2.0:1782480804.777697:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388158976 00000100:00100000:2.0:1782480804.777739:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782480804.777746:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388158976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480804.777791:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388158976:12345-0@lo:400:kworker.0 Request processed in 46us (977us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480804.777797:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1782480804.777836:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388159232:0@lo:400:kworker.0 00000100:00100000:2.0:1782480804.777850:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388158720:0@lo:400:kworker.0 00000100:00100000:2.0:1782480804.777880:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388158976:0@lo:400:kworker.0 00000100:00080000:3.0:1782480804.780632:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782480804.830924:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480805.855785:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480806.878851:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480807.333110:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480807.333140:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388159360:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480807.333238:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480807.333309:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388159360 00000100:00100000:1.0:1782480807.333318:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388159360 00000100:00100000:1.0:1782480807.333376:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1782480807.333385:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388159360:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480807.333420:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480807.333464:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388159360:12345-0@lo:13:osp-pre-0-0.0 Request processed in 80us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480807.333471:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:1.0:1782480807.333521:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c528dc00 x1869066388159360/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480823 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1782480807.333614:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480807.333738:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388159360:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480807.412688:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480807.412728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480807.412849:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366104320 00000100:00100000:1.0:1782480807.412861:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366104320 00000100:00100000:1.0:1782480807.412943:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:1.0:1782480807.412960:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366104320:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480807.413056:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366104320:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 102us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480807.413064:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00080000:1.0:1782480807.413089:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480807.413710:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366104064 00000100:00100000:2.0:1782480807.413716:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366104064 00000100:00100000:2.0:1782480807.413756:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:2.0:1782480807.413765:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366104064:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480807.413797:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366104064:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 34us (1162us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480807.413803:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:0.0:1782480807.414107:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480807.414157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480807.414196:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480807.414223:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366104576 00000100:00100000:0.0:1782480807.414227:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366104576 00000100:00100000:0.0:1782480807.414264:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366104448 00000100:00100000:0.0:1782480807.414267:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366104448 00000100:00100000:0.0:1782480807.414288:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:0.0:1782480807.414296:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366104576:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480807.414326:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366104576:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 31us (222us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480807.414347:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:0.0:1782480807.414363:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:0.0:1782480807.414369:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fecc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366104448:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480807.414394:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fecc2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366104448:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480807.414400:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00080000:0.0:1782480807.414570:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480807.414574:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480807.417121:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366104192 00000100:00100000:3.0:1782480807.417146:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366104192 00000100:00100000:3.0:1782480807.417258:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1782480807.417270:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366104192:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480807.417390:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366104192:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 122us (3234us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480807.417399:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00080000:0.0:1782480807.420026:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782480807.902923:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480808.928498:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480809.887150:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388159488:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480809.887227:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480809.887356:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388159488 00000100:00100000:2.0:1782480809.887365:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388159488 00000100:00100000:2.0:1782480809.887436:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1782480809.887446:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388159488:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480809.887482:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480809.887533:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388159488:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480809.887555:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1782480809.887609:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5dc700 x1869066388159488/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480825 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480809.887628:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388159488:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782480809.887712:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480809.888411:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388159744:0@lo:400:kworker.0 00000100:00100000:3.0:1782480809.888455:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480809.888486:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480809.888492:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388159872:0@lo:400:kworker.0 00000100:00100000:3.0:1782480809.888515:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480809.888557:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388159744 00000100:00100000:3.0:1782480809.888563:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388159744 00000100:00100000:3.0:1782480809.888607:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388159872 00000100:00100000:3.0:1782480809.888611:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388159872 00000100:00100000:3.0:1782480809.888638:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782480809.888644:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388159744:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480809.888776:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388159744:12345-0@lo:400:kworker.0 Request processed in 132us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480809.888783:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1782480809.888798:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1782480809.888804:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388159872:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480809.888832:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388159872:12345-0@lo:400:kworker.0 Request processed in 28us (316us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480809.888838:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:3.0:1782480809.888866:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480809.888888:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388159872:0@lo:400:kworker.0 00000100:00100000:3.0:1782480809.888899:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388159744:0@lo:400:kworker.0 00000100:00100000:0.0:1782480809.889033:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388159616:0@lo:400:kworker.0 00000100:00100000:0.0:1782480809.889079:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480809.889115:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388160128:0@lo:400:kworker.0 00000100:00100000:0.0:1782480809.889138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480809.889158:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480809.889164:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388160000:0@lo:400:kworker.0 00000100:00100000:0.0:1782480809.889187:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480809.889213:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388160000 00000100:00100000:0.0:1782480809.889217:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388160000 00000100:00100000:0.0:1782480809.889250:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1782480809.889257:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388160000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480809.889293:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388160000:12345-0@lo:400:kworker.0 Request processed in 36us (105us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480809.889299:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:0.0:1782480809.889316:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782480809.889341:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d8006bc380 x1869066388160000/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480825 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480809.889352:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388160000:0@lo:400:kworker.0 00000100:00100000:0.0:1782480809.889369:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388160128 00000100:00100000:0.0:1782480809.889372:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388160128 00000100:00100000:0.0:1782480809.889401:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782480809.889408:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388160128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480809.889440:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388160128:12345-0@lo:400:kworker.0 Request processed in 33us (301us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480809.889446:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1782480809.889462:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480809.889477:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006be300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388160128:0@lo:400:kworker.0 00000100:00100000:3.0:1782480809.889825:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388159616 00000100:00100000:3.0:1782480809.889830:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388159616 00000100:00100000:3.0:1782480809.889872:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:3.0:1782480809.889880:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388159616:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480809.889918:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388159616:12345-0@lo:400:kworker.0 Request processed in 39us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480809.889924:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:0.0:1782480809.890367:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388159616:0@lo:400:kworker.0 00010000:00010000:1.0:1782480809.952952:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480810.974979:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480811.999112:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480812.447569:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388160256:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480812.447652:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480812.447890:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388160256 00000100:00100000:2.0:1782480812.447900:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388160256 00000100:00100000:2.0:1782480812.447964:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782480812.447973:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388160256:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480812.448008:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480812.449571:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388160256:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1590us (1910us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480812.449584:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1782480812.450968:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c12ace00 x1869066388160256/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480828 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480812.450996:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388160256:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782480812.451044:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480812.524458:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480812.524501:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480812.524539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480812.524578:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480812.524603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480812.524729:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366104704 00000100:00100000:3.0:1782480812.524740:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366104704 00000100:00100000:3.0:1782480812.524797:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 228 00000100:00100000:3.0:1782480812.524824:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366104704:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480812.524903:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366104704:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 82us (455us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480812.524910:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 228 00000100:00100000:1.0:1782480812.525016:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366104960 00000100:00100000:1.0:1782480812.525020:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366104960 00000100:00100000:1.0:1782480812.525070:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366104832 00000100:00100000:1.0:1782480812.525073:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366104832 00000100:00100000:1.0:1782480812.525098:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:1.0:1782480812.525105:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366104960:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480812.525143:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366104960:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 38us (641us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480812.525150:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:1.0:1782480812.525164:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:1.0:1782480812.525170:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366104832:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480812.525196:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366104832:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480812.525202:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00080000:3.0:1782480812.525720:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480812.525880:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366105216 00000100:00100000:1.0:1782480812.525886:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366105216 00000100:00100000:1.0:1782480812.525934:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366105088 00000100:00100000:1.0:1782480812.525938:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366105088 00000100:00100000:1.0:1782480812.525964:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:1.0:1782480812.525971:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366105216:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480812.526030:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366105216:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 59us (1490us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480812.526036:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00080000:3.0:1782480812.526116:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480812.526119:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480812.526176:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:1.0:1782480812.526186:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366105088:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480812.526214:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366105088:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 30us (1609us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480812.532150:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00010000:00010000:1.0:1782480813.027266:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480814.049309:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480815.006943:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388160768:0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007018:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480815.007071:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1782480815.007076:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388160384:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480815.007101:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480815.007122:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388160896:0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007144:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480815.007171:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388160640:0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007194:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480815.007211:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388161152:0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007229:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480815.007242:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1782480815.007247:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388160512:0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007270:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480815.007306:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388161024:0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007327:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480815.007475:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388160768 00000100:00100000:1.0:1782480815.007483:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388160768 00000100:00100000:1.0:1782480815.007542:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388160640 00000100:00100000:1.0:1782480815.007545:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388160640 00000100:00100000:1.0:1782480815.007557:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388161024 00000100:00100000:1.0:1782480815.007559:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388161024 00000100:00100000:1.0:1782480815.007573:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782480815.007580:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388160768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007629:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388160768:12345-0@lo:400:kworker.0 Request processed in 48us (609us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480815.007635:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782480815.007652:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782480815.007691:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388160640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007721:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388160640:12345-0@lo:400:kworker.0 Request processed in 64us (526us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480815.007727:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782480815.007739:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782480815.007745:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388161024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007771:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388161024:12345-0@lo:400:kworker.0 Request processed in 26us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480815.007776:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1782480815.007793:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388160896 00000100:00100000:1.0:1782480815.007797:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388160896 00000100:00100000:1.0:1782480815.007820:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388161152 00000100:00100000:1.0:1782480815.007823:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388161152 00000100:00100000:1.0:1782480815.007840:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782480815.007854:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388160896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007883:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388160896:12345-0@lo:400:kworker.0 Request processed in 30us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480815.007889:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782480815.007900:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782480815.007907:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388161152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.007930:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388161152:12345-0@lo:400:kworker.0 Request processed in 25us (700us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480815.007935:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782480815.007987:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388161024:0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.008000:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388160640:0@lo:400:kworker.0 00010000:00080000:1.0:1782480815.008011:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d8006bdf80 x1869066388161152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480815.008022:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388161152:0@lo:400:kworker.0 00010000:00080000:1.0:1782480815.008053:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d8006bca80 x1869066388160896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480831 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480815.008062:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388160896:0@lo:400:kworker.0 00000100:00100000:1.0:1782480815.008073:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388160768:0@lo:400:kworker.0 00000100:00080000:3.0:1782480815.008170:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480815.008175:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480815.008177:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480815.008236:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388160384 00000100:00100000:2.0:1782480815.008240:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388160384 00000100:00100000:2.0:1782480815.008275:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782480815.008281:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388160384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480815.008308:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480815.008361:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388160384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 80us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480815.008368:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782480815.008397:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388160512 00000100:00100000:2.0:1782480815.008400:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388160512 00000100:00100000:2.0:1782480815.008423:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1782480815.008429:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388160512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480815.008464:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388160512:12345-0@lo:400:kworker.0 Request processed in 35us (1192us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480815.008475:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:2.0:1782480815.008515:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388160512:0@lo:400:kworker.0 00010000:00080000:1.0:1782480815.008845:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5ded80 x1869066388160384/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480831 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480815.008872:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388160384:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782480815.070832:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480816.105037:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480817.123379:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480817.566999:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782480817.567032:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388161280:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480817.567139:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480817.567224:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388161280 00000100:00100000:3.0:1782480817.567234:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388161280 00000100:00100000:3.0:1782480817.567318:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1782480817.567329:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388161280:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480817.567374:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480817.567440:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388161280:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (301us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480817.567448:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1782480817.567483:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782480817.567521:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c12ad500 x1869066388161280/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480833 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480817.567545:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388161280:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480817.659379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480817.659448:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480817.659542:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366105472 00000100:00100000:0.0:1782480817.659556:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366105472 00000100:00100000:0.0:1782480817.659689:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:0.0:1782480817.659703:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366105472:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480817.659829:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366105472:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 129us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480817.659838:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00080000:2.0:1782480817.660043:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480817.660163:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366105344 00000100:00100000:3.0:1782480817.660170:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366105344 00000100:00100000:3.0:1782480817.660289:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 230 00000100:00100000:3.0:1782480817.660298:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366105344:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480817.660352:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366105344:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 55us (992us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480817.660359:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 230 00000100:00100000:2.0:1782480817.679682:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480817.679725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480817.679762:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480817.679798:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366105728 00000100:00100000:2.0:1782480817.679810:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366105728 00000100:00100000:2.0:1782480817.679878:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366105856 00000100:00100000:2.0:1782480817.679881:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366105856 00000100:00100000:2.0:1782480817.679905:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:2.0:1782480817.679916:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2349:x1869066366105728:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:2.0:1782480817.679955:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf5197 00000100:00080000:2.0:1782480817.679965:0:6608:0:(import.c:65:import_set_state_nolock()) ffff91d7c4a8c800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782480817.680019:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1782480817.680249:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1782480817.680260:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2349:x1869066366105856:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:0.0:1782480817.680277:0:8498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf519e 00000100:00080000:0.0:1782480817.680283:0:8498:0:(import.c:65:import_set_state_nolock()) ffff91d7ed06e000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782480817.680309:0:8498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1782480817.680712:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+2:2349:x1869066366105856:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 452us (946us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480817.680722:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:2.0:1782480817.682593:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+2:2349:x1869066366105728:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 2662us (2850us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480817.682609:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00010000:00010000:2.0:1782480817.682686:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782480817.682711:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480817.682718:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480817.683837:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366105600 00000100:00100000:1.0:1782480817.683859:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366105600 00000100:00100000:1.0:1782480817.683948:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:1.0:1782480817.683960:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2351:x1869066366105600:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480817.684068:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2351:x1869066366105600:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 109us (4421us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480817.684076:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 91 00010000:00010000:1.0:1782480817.684104:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782480817.686141:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782480818.143439:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480819.167938:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480820.128590:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388161408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480820.128708:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480820.128817:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388161408 00000100:00100000:2.0:1782480820.128829:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388161408 00000100:00100000:2.0:1782480820.128901:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782480820.128911:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388161408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480820.128956:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480820.129005:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388161408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480820.129012:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1782480820.129037:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1782480820.129072:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef5ded80 x1869066388161408/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480836 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480820.129095:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ded80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388161408:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480820.130297:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388161536:0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.130364:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480820.130422:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388162048:0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.130455:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480820.130485:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480820.130492:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388161664:0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.130514:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480820.130547:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388161792:0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.130583:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480820.130606:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480820.130613:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388161920:0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.130640:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480820.130694:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388162048 00000100:00100000:2.0:1782480820.130702:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388162048 00000100:00100000:2.0:1782480820.130752:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388161664 00000100:00100000:2.0:1782480820.130756:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388161664 00000100:00100000:2.0:1782480820.130771:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388161792 00000100:00100000:2.0:1782480820.130773:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388161792 00000100:00100000:2.0:1782480820.130790:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782480820.130799:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388162048:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.130851:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388162048:12345-0@lo:400:kworker.0 Request processed in 52us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480820.130858:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1782480820.130876:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782480820.130882:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388161664:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.130909:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388161664:12345-0@lo:400:kworker.0 Request processed in 27us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480820.130915:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1782480820.130925:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782480820.130930:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388161792:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.130960:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388161792:12345-0@lo:400:kworker.0 Request processed in 29us (376us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480820.130966:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1782480820.130991:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388161920 00000100:00100000:2.0:1782480820.130995:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388161920 00000100:00100000:2.0:1782480820.131036:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782480820.131042:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388161920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.131074:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388161920:12345-0@lo:400:kworker.0 Request processed in 33us (433us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480820.131080:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1782480820.131097:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480820.131102:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480820.131135:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388161664:0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.131150:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388162048:0@lo:400:kworker.0 00000100:00100000:0.0:1782480820.131355:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388161536 00000100:00100000:0.0:1782480820.131362:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388161536 00000100:00100000:0.0:1782480820.131397:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:0.0:1782480820.131405:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388161536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480820.131460:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388161536:12345-0@lo:400:kworker.0 Request processed in 56us (1096us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480820.131466:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:2.0:1782480820.132383:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388161536:0@lo:400:kworker.0 00010000:00080000:2.0:1782480820.132441:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4ca300 x1869066388161920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480836 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480820.132456:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388161920:0@lo:400:kworker.0 00000100:00100000:2.0:1782480820.132472:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388161792:0@lo:400:kworker.0 00010000:00010000:3.0:1782480820.196263:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480821.214838:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782480821.750154:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of da13206b-be2f-48d4-ba4f-8aa0d1f46dad 00000020:00000080:2.0:1782480821.750169:0:7517:0:(genops.c:906:class_export_put()) final put ffff91d7ed06a000/da13206b-be2f-48d4-ba4f-8aa0d1f46dad 00000020:00000080:1.0:1782480821.756946:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ed06a000/da13206b-be2f-48d4-ba4f-8aa0d1f46dad for lustre-OST0001 00000020:00000080:1.0:1782480821.760580:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ed06e000 for lustre-OST0001 00010000:00010000:2.0:1782480822.241484:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480822.688124:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480822.688148:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388162176:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480822.688296:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480822.688388:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388162176 00000100:00100000:1.0:1782480822.688397:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388162176 00000100:00100000:1.0:1782480822.688464:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782480822.688475:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388162176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480822.688513:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480822.688564:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388162176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480822.688571:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00080000:1.0:1782480822.688593:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782480822.688627:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d8006bea00 x1869066388162176/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480838 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480822.688645:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388162176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480822.776597:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480822.776645:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480822.776733:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366105984 00000100:00100000:2.0:1782480822.776744:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366105984 00000100:00100000:2.0:1782480822.776795:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 232 00000100:00100000:2.0:1782480822.776805:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2351:x1869066366105984:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480822.776882:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2351:x1869066366105984:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480822.776890:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 232 00000100:00100000:2.0:1782480822.777564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480822.791106:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366106240 00000100:00100000:1.0:1782480822.791141:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366106240 00000100:00100000:1.0:1782480822.791233:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366106112 00000100:00100000:1.0:1782480822.791236:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366106112 00000100:00100000:1.0:1782480822.791277:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:1.0:1782480822.791287:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2351:x1869066366106240:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480822.791441:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:3.0:1782480822.791451:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366106112:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480822.791534:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366106112:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 85us (13972us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480822.791542:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:1.0:1782480822.791634:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2351:x1869066366106240:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 349us (14989us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480822.791640:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00080000:2.0:1782480822.791737:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00100000:0.0:1782480822.836315:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of da13206b-be2f-48d4-ba4f-8aa0d1f46dad 00000020:00000080:0.0:1782480822.836328:0:6632:0:(genops.c:906:class_export_put()) final put ffff91d7c4a88800/da13206b-be2f-48d4-ba4f-8aa0d1f46dad 00000020:00000080:2.0:1782480822.836421:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c4a88800/da13206b-be2f-48d4-ba4f-8aa0d1f46dad for lustre-OST0000 00000020:00000080:2.0:1782480822.836482:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7c4a8c800 for lustre-OST0000 00010000:00010000:3.0:1782480823.263009:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480824.298145:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782480824.692889:0:10896:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:3.0:1782480825.247161:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388162304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480825.247268:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480825.247514:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388162304 00000100:00100000:2.0:1782480825.247528:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388162304 00000100:00100000:2.0:1782480825.247631:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1782480825.247644:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388162304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480825.247730:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480825.247795:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388162304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (527us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480825.247802:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:2.0:1782480825.247851:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b1c00 x1869066388162304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480841 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480825.247873:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388162304:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782480825.248068:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480825.248300:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388162560:0@lo:400:kworker.0 00000100:00100000:3.0:1782480825.248358:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480825.248399:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480825.248405:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388162688:0@lo:400:kworker.0 00000100:00100000:3.0:1782480825.248431:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480825.248475:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388162560 00000100:00100000:3.0:1782480825.248481:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388162560 00000100:00100000:3.0:1782480825.248521:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388162688 00000100:00100000:3.0:1782480825.248524:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388162688 00000100:00100000:3.0:1782480825.248575:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782480825.248582:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388162560:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480825.248632:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388162560:12345-0@lo:400:kworker.0 Request processed in 50us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480825.248638:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:3.0:1782480825.248652:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782480825.248691:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388162688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480825.248718:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388162688:12345-0@lo:400:kworker.0 Request processed in 61us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480825.248725:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00080000:3.0:1782480825.248744:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480825.248764:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388162688:0@lo:400:kworker.0 00000100:00100000:3.0:1782480825.248774:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388162560:0@lo:400:kworker.0 00000100:00100000:0.0:1782480825.248859:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388162432:0@lo:400:kworker.0 00000100:00100000:0.0:1782480825.248904:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480825.248963:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388162944:0@lo:400:kworker.0 00000100:00100000:0.0:1782480825.248990:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480825.249024:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782480825.249031:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388162816:0@lo:400:kworker.0 00000100:00100000:0.0:1782480825.249058:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480825.249083:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388162944 00000100:00100000:0.0:1782480825.249086:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388162944 00000100:00100000:0.0:1782480825.249118:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782480825.249125:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388162944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480825.249159:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388162944:12345-0@lo:400:kworker.0 Request processed in 35us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480825.249165:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00080000:0.0:1782480825.249182:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480825.249200:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006be680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388162944:0@lo:400:kworker.0 00000100:00100000:3.0:1782480825.249587:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388162432 00000100:00100000:3.0:1782480825.249594:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388162432 00000100:00100000:3.0:1782480825.249642:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1782480825.249650:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388162432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480825.249722:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388162432:12345-0@lo:400:kworker.0 Request processed in 73us (817us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480825.249729:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:0.0:1782480825.249824:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388162432:0@lo:400:kworker.0 00000100:00100000:2.0:1782480825.251109:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388162816 00000100:00100000:2.0:1782480825.251123:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388162816 00000100:00100000:2.0:1782480825.251221:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782480825.251232:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388162816:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480825.251352:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388162816:12345-0@lo:400:kworker.0 Request processed in 123us (2292us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480825.251360:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:1.0:1782480825.251553:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d8006bfb80 x1869066388162816/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480841 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480825.251572:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388162816:0@lo:400:kworker.0 00000100:00080000:0.0:1782480825.251656:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782480825.314641:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480826.334912:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480827.362590:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480827.807170:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480827.807205:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388163072:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480827.807315:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480827.807741:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388163072 00000100:00100000:1.0:1782480827.807752:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388163072 00000100:00100000:1.0:1782480827.807831:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782480827.807842:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388163072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480827.807889:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480827.807948:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388163072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480827.807955:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1782480827.808006:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d8006bfb80 x1869066388163072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480843 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480827.808027:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388163072:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782480827.808224:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480827.892025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480827.893430:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480827.893483:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480827.894203:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366106496 00000100:00100000:3.0:1782480827.894229:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366106496 00000100:00100000:3.0:1782480827.894341:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366106624 00000100:00100000:3.0:1782480827.894344:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366106624 00000100:00100000:3.0:1782480827.894375:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:3.0:1782480827.894385:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366106496:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480827.894515:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4cbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366106496:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 130us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480827.894524:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:3.0:1782480827.894548:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:3.0:1782480827.894555:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366106624:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480827.894581:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366106624:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480827.894587:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00080000:0.0:1782480827.897765:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480827.900454:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366106368 00000100:00100000:2.0:1782480827.900490:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366106368 00000100:00100000:2.0:1782480827.900634:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 234 00000100:00100000:2.0:1782480827.900646:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366106368:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480827.900806:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366106368:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 162us (8803us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480827.900815:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 234 00010000:00010000:0.0:1782480828.383473:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480829.407514:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480830.368898:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480830.368933:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388163200:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480830.369036:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480830.369196:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388163200 00000100:00100000:0.0:1782480830.369210:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388163200 00000100:00100000:0.0:1782480830.369321:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1782480830.369332:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388163200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480830.369385:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480830.369461:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388163200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 130us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480830.369470:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:0.0:1782480830.369518:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b2a00 x1869066388163200/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480846 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480830.369541:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388163200:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782480830.369767:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480830.372997:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388163712:0@lo:400:kworker.0 00000100:00100000:0.0:1782480830.373100:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480830.373156:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480830.373163:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388163584:0@lo:400:kworker.0 00000100:00100000:0.0:1782480830.373196:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480830.373450:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388163328:0@lo:400:kworker.0 00000100:00100000:3.0:1782480830.373498:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480830.373537:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388163840:0@lo:400:kworker.0 00000100:00100000:3.0:1782480830.373564:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480830.373590:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480830.373598:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388163456:0@lo:400:kworker.0 00000100:00100000:3.0:1782480830.373624:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480830.373684:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388163584 00000100:00100000:3.0:1782480830.373696:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388163584 00000100:00100000:3.0:1782480830.373770:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388163840 00000100:00100000:3.0:1782480830.373774:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388163840 00000100:00100000:3.0:1782480830.373789:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388163456 00000100:00100000:3.0:1782480830.373791:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388163456 00000100:00100000:3.0:1782480830.373807:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782480830.373818:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388163584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480830.373908:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388163584:12345-0@lo:400:kworker.0 Request processed in 79us (699us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480830.373942:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:3.0:1782480830.373969:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782480830.373975:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388163840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480830.374012:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388163840:12345-0@lo:400:kworker.0 Request processed in 37us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480830.374019:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:3.0:1782480830.374032:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782480830.374038:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388163456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480830.374067:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388163456:12345-0@lo:400:kworker.0 Request processed in 29us (442us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480830.374073:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:3.0:1782480830.374099:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388163328 00000100:00100000:3.0:1782480830.374103:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388163328 00000100:00100000:3.0:1782480830.374131:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1782480830.374138:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388163328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480830.374177:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388163328:12345-0@lo:400:kworker.0 Request processed in 40us (679us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480830.374185:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1782480830.374403:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388163456:0@lo:400:kworker.0 00000100:00100000:3.0:1782480830.374417:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388163328:0@lo:400:kworker.0 00000100:00100000:3.0:1782480830.374429:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388163840:0@lo:400:kworker.0 00000100:00080000:3.0:1782480830.374468:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480830.374493:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388163584:0@lo:400:kworker.0 00000100:00100000:0.0:1782480830.374596:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388163712 00000100:00100000:0.0:1782480830.374603:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388163712 00000100:00100000:0.0:1782480830.374687:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782480830.374695:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388163712:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480830.374741:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388163712:12345-0@lo:400:kworker.0 Request processed in 47us (1641us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480830.374748:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1782480830.375743:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1782480830.375798:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4c8380 x1869066388163712/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480846 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480830.375821:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388163712:0@lo:400:kworker.0 00010000:00010000:0.0:1782480830.438511:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782480830.679569:0:11043:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc3f872020 20000000:00000080:3.0:1782480830.679594:0:11043:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d7c68b3c00 uarg=0000000000000000 20000000:01000000:3.0:1782480830.679655:0:11043:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782480830.679696:0:11043:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1782480830.679703:0:11043:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1782480830.682593:0:11044:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:0.0:1782480830.683068:0:11043:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782480830.688013:0:11043:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1782480830.688057:0:11043:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688078:0:11043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c779ba00/0x4776e02a9acf5151 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf514a expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688086:0:11043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c779a200/0x4776e02a9acf515f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5158 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688110:0:11043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf516d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5166 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688119:0:11043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c779a800/0x4776e02a9acf5174 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbab expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688125:0:11043:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802059400/0x4776e02a9acf5189 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbe3 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688133:0:11043:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688184:0:11043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802059400/0x4776e02a9acf5189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbe3 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688203:0:11043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d802059400/0x4776e02a9acf5189 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbe3 expref: 12 pid: 5796 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480830.688220:0:11043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11043:1869066388163968:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480830.688358:0:11043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c779a800/0x4776e02a9acf5174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbab expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688368:0:11043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d7c779a800/0x4776e02a9acf5174 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbab expref: 12 pid: 5797 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480830.688377:0:11043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11043:1869066388164096:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480830.688410:0:11043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf516d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf5166 expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688430:0:11043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf516d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf5166 expref: 18 pid: 5796 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480830.688440:0:11043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11043:1869066388164224:0@lo:104: 00000100:00100000:0.0:1782480830.688493:0:11043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480830.688546:0:11043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c779a200/0x4776e02a9acf515f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf5158 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688554:0:11043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c779a200/0x4776e02a9acf515f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf5158 expref: 18 pid: 5794 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480830.688564:0:11043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11043:1869066388164352:0@lo:104: 00000100:00100000:0.0:1782480830.688587:0:11043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480830.688610:0:11043:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c779ba00/0x4776e02a9acf5151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf514a expref: 18 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.688617:0:11043:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c779ba00/0x4776e02a9acf5151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf514a expref: 18 pid: 5796 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480830.688624:0:11043:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11043:1869066388164480:0@lo:104: 00000100:00100000:0.0:1782480830.688643:0:11043:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480830.688685:0:11043:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480830.690751:0:8323:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388164224 00000100:00100000:2.0:1782480830.690771:0:8323:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388164224 00000100:00100000:2.0:1782480830.690827:0:8323:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388164352 00000100:00100000:2.0:1782480830.690831:0:8323:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388164352 00000100:00100000:2.0:1782480830.690843:0:8323:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388164480 00000100:00100000:2.0:1782480830.690846:0:8323:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388164480 00000100:00100000:2.0:1782480830.690866:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782480830.690876:0:8323:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:11043:x1869066388164224:12345-0@lo:104: 00010000:00010000:2.0:1782480830.690898:0:8323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691010:0:8323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782480830.691017:0:8323:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+5:11043:x1869066388164224:12345-0@lo:104: Request processed in 143us (2524us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480830.691025:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1782480830.691048:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782480830.691055:0:8323:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:11043:x1869066388164352:12345-0@lo:104: 00010000:00010000:2.0:1782480830.691063:0:8323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691122:0:8323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782480830.691129:0:8323:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:11043:x1869066388164352:12345-0@lo:104: Request processed in 75us (2540us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480830.691134:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1782480830.691146:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1782480830.691151:0:8323:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:11043:x1869066388164480:12345-0@lo:104: 00010000:00010000:2.0:1782480830.691161:0:8323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691194:0:8323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1782480830.691200:0:8323:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:11043:x1869066388164480:12345-0@lo:104: Request processed in 49us (2556us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480830.691205:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1782480830.691245:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1782480830.691253:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691261:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779be00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:2.0:1782480830.691266:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691278:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480830.691287:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480830.691294:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480830.691361:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691368:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1782480830.691380:0:11043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11043:1869066388164224:0@lo:104: 00010000:00010000:2.0:1782480830.691404:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480830.691409:0:11043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11043:1869066388164352:0@lo:104: 00010000:00010000:2.0:1782480830.691422:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c779be00/0x4776e02a9acf5166 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf516d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480830.691432:0:11043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3baa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11043:1869066388164480:0@lo:104: 00010000:00010000:2.0:1782480830.691444:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1782480830.691450:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691457:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167ba00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:2.0:1782480830.691460:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691467:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480830.691474:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480830.691480:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480830.691517:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691524:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480830.691553:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691571:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167ba00/0x4776e02a9acf5158 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf515f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691582:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480830.691586:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691592:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b800 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:2.0:1782480830.691594:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691601:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480830.691608:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480830.691613:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480830.691627:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691633:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480830.691642:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.691649:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf514a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf5151 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480830.691693:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388164736:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480830.691696:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480830.691706:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480830.691709:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480830.691718:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480830.691726:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480830.691752:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388164608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480830.691764:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480830.691805:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480830.691862:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480830.691876:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388164864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480830.691888:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388164736 00000100:00100000:2.0:1782480830.691897:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388164736 00000100:00100000:0.0:1782480830.691913:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1782480830.691929:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c779a200/0x4776e02a9acf515f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5158 expref: 19 pid: 5794 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480830.691956:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388164608 00000100:00100000:2.0:1782480830.691960:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388164608 00010000:00010000:2.0:1782480830.691975:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf516d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5166 expref: 20 pid: 5796 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480830.691986:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388164864 00000100:00100000:2.0:1782480830.691989:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388164864 00010000:00010000:2.0:1782480830.692000:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c779ba00/0x4776e02a9acf5151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf514a expref: 21 pid: 5796 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480830.692013:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480830.692019:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d1300050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+21:3312:x1869066388164736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480830.692033:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480830.692039:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c779a200/0x4776e02a9acf515f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5158 expref: 21 pid: 5794 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.692050:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c779a200/0x4776e02a9acf515f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf5158 expref: 21 pid: 5794 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.692067:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779a200/0x4776e02a9acf515f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf5158 expref: 21 pid: 5794 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.692090:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480830.692139:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d1300050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+20:3312:x1869066388164736:12345-0@lo:103:ldlm_bl.0 Request processed in 119us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480830.692147:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1782480830.692198:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480830.692205:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388164608:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480830.692212:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480830.692217:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf516d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf5166 expref: 19 pid: 5796 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.692240:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf516d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf5166 expref: 19 pid: 5796 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.692253:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf516d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf5166 expref: 19 pid: 5796 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.692262:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480830.692292:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3311:x1869066388164608:12345-0@lo:103:ldlm_bl.0 Request processed in 87us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480830.692298:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480830.692311:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782480830.692317:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3312:x1869066388164864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1782480830.692325:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480830.692329:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c779ba00/0x4776e02a9acf5151 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf514a expref: 17 pid: 5796 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.692338:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c779ba00/0x4776e02a9acf5151 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf514a expref: 17 pid: 5796 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.692357:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779ba00/0x4776e02a9acf5151 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf514a expref: 17 pid: 5796 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.692367:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480830.692395:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3312:x1869066388164864:12345-0@lo:103:ldlm_bl.0 Request processed in 77us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480830.692405:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782480830.692442:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388164864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480830.692471:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388164608:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480830.692538:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388164736:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480830.697739:0:11043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11043:1869066388163968:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480830.697753:0:11043:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11043:1869066388164096:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480830.697810:0:11043:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480830.702769:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480830.702884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480830.706820:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366106752 00000100:00100000:2.0:1782480830.706842:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366106752 00010000:00010000:2.0:1782480830.706905:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802059400/0x4776e02a9acf5189 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbe3 expref: 13 pid: 5796 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480830.706955:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366106880 00000100:00100000:2.0:1782480830.706959:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366106880 00010000:00010000:2.0:1782480830.706970:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c779a800/0x4776e02a9acf5174 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbab expref: 14 pid: 5797 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480830.706986:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:2.0:1782480830.706995:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3a65011-408e-4936-8eb0-c95e426cdd7c+14:2350:x1869066366106752:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480830.707024:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480830.707030:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802059400/0x4776e02a9acf5189 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbe3 expref: 14 pid: 5796 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707043:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802059400/0x4776e02a9acf5189 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbe3 expref: 14 pid: 5796 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707062:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802059400/0x4776e02a9acf5189 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbe3 expref: 14 pid: 5796 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707097:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480830.707249:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366106752:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 253us (4491us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480830.707259:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:2.0:1782480830.707279:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:2.0:1782480830.707285:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:2350:x1869066366106880:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480830.707294:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480830.707299:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c779a800/0x4776e02a9acf5174 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbab expref: 12 pid: 5797 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707308:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c779a800/0x4776e02a9acf5174 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbab expref: 12 pid: 5797 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707318:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779a800/0x4776e02a9acf5174 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbab expref: 12 pid: 5797 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707442:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707451:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707476:0:5787:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707485:0:5787:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707504:0:5787:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707511:0:5787:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707518:0:5787:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782480830.707523:0:5787:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707533:0:5787:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707548:0:5787:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480830.707559:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480830.707580:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:2350:x1869066366106880:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 294us (4696us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480830.707587:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00010000:00010000:0.0:1782480830.707769:0:11043:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.707779:0:11043:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480830.707786:0:11043:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51a5 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11043 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480831.462085:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480832.043893:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480832.044324:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366107008 00000100:00100000:0.0:1782480832.044338:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366107008 00000100:00100000:0.0:1782480832.044429:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 236 00000100:00100000:0.0:1782480832.044441:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:5569:x1869066366107008:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480832.044469:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480832.044500:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc0d expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.046748:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc0d expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.046779:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc0d expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.046791:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297ba00, rc 0) 00000100:00100000:0.0:1782480832.046919:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366107008:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 2479us (3040us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480832.046930:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 236 00000100:00100000:1.0:1782480832.051294:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480832.051698:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366107136 00000100:00100000:3.0:1782480832.051722:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366107136 00000100:00100000:3.0:1782480832.051807:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 237 00000100:00100000:3.0:1782480832.051818:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366107136:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480832.053098:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366107136:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 1269us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480832.053114:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 237 00000100:00100000:2.0:1782480832.071513:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480832.071655:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366107264 00000100:00100000:0.0:1782480832.071722:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366107264 00000100:00100000:0.0:1782480832.071798:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 238 00000100:00100000:0.0:1782480832.071809:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366107264:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480832.072162:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366107264:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 352us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480832.072172:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 238 00000100:00100000:2.0:1782480832.091558:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480832.091927:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366107392 00000100:00100000:0.0:1782480832.091941:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366107392 00000100:00100000:0.0:1782480832.092048:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 239 00000100:00100000:0.0:1782480832.092062:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366107392:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480832.092091:0:5796:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480832.092117:0:5796:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297b800/0x4776e02a9acf51b3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc14 expref: -99 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.092159:0:5796:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297b800/0x4776e02a9acf51b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc14 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.092195:0:5796:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297b800/0x4776e02a9acf51b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc14 expref: 13 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.092221:0:5796:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b800, rc 0) 00000100:00100000:0.0:1782480832.092319:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:5569:x1869066366107392:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 260us (781us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480832.092328:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 239 00000100:00100000:1.0:1782480832.108440:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480832.111040:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366107520 00000100:00100000:3.0:1782480832.111062:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366107520 00000100:00100000:3.0:1782480832.111153:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 240 00000100:00100000:3.0:1782480832.111165:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:5569:x1869066366107520:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480832.117319:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:5569:x1869066366107520:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 6128us (8870us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480832.117342:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 240 00000100:00100000:1.0:1782480832.146364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480832.146644:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366107648 00000100:00100000:2.0:1782480832.146952:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366107648 00000100:00100000:2.0:1782480832.147035:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 241 00000100:00100000:2.0:1782480832.147047:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:5569:x1869066366107648:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480832.147620:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:5569:x1869066366107648:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 571us (1276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480832.147629:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 241 00010000:00010000:2.0:1782480832.482825:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1782480832.735229:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480832.735240:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d6c29a2000 from 7 10000000:01000000:2.0:1782480832.735246:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480832.735331:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480832.735345:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480832.735357:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480832.735392:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388164992:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480832.735505:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480832.735591:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480832.736142:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388164992 00000100:00100000:3.0:1782480832.736154:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388164992 00000100:00100000:3.0:1782480832.736241:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:3.0:1782480832.736282:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388164992:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480832.736303:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480832.736320:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779a000/0x4776e02a9acf51c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf51ba expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480832.736350:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779a000/0x4776e02a9acf51c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf51ba expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480832.736362:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779a000/0x4776e02a9acf51c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf51ba expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480832.736372:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a000, rc 0) 00000100:00100000:3.0:1782480832.736440:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388164992:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 159us (934us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480832.736448:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1782480832.736613:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388164992:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480832.736635:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480832.736644:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480832.736777:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480832.736812:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480832.736858:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480832.737161:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388165120 00000100:00100000:3.0:1782480832.737167:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388165120 00000100:00100000:3.0:1782480832.737219:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1782480832.737227:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388165120:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480832.737894:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388165120:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 665us (1078us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480832.737903:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:2.0:1782480832.738090:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165120:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480832.738156:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165248:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480832.738388:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480832.738429:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794c00 going to sleep for 11 seconds 00000100:00100000:1.0:1782480832.738799:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388165248 00000100:00100000:1.0:1782480832.738809:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388165248 00000100:00100000:1.0:1782480832.738882:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1782480832.738890:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388165248:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480832.739214:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388165248:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 323us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480832.739222:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:2.0:1782480832.739317:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165248:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782480832.742895:0:11064:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1782480832.743495:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1782480832.743521:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1782480832.743541:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480832.743556:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480832.743569:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1782480832.743572:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c7ca2800 from 7 10000000:01000000:2.0:1782480832.743575:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1782480832.743628:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480832.743637:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480832.743650:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480832.743889:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1782480832.743989:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480832.744138:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6794c00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480832.745230:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388165376 00000100:00100000:3.0:1782480832.745246:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388165376 00000100:00100000:2.0:1782480832.745983:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:2.0:1782480832.745998:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388165376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480832.746019:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480832.746054:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d802058000/0x4776e02a9acf51cf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf51c8 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480832.746091:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d802058000/0x4776e02a9acf51cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf51c8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480832.746104:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d802058000/0x4776e02a9acf51cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf51c8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480832.746115:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d802058000, rc 0) 00000100:00100000:2.0:1782480832.746238:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388165376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 244us (2249us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480832.746246:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1782480832.746373:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480832.746399:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480832.746431:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480832.746551:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480832.746588:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480832.747524:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4540 going to sleep for 11 seconds 00000100:00100000:1.0:1782480832.752306:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388165504 00000100:00100000:1.0:1782480832.752333:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388165504 00000100:00100000:1.0:1782480832.752431:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1782480832.752444:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388165504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480832.754119:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388165504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1591us (7443us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480832.754612:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00100000:1.0:1782480832.756006:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12ac380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480832.756649:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480832.757354:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480832.757461:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d6c3922a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480832.757888:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388165632 00000100:00100000:2.0:1782480832.757901:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388165632 00000100:00100000:2.0:1782480832.758009:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:2.0:1782480832.758021:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388165632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480832.759282:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388165632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1254us (2241us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480832.759297:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:3.0:1782480832.759361:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165632:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782480832.761093:0:11065:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782480832.764391:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782480832.764446:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782480832.764467:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.764484:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480832.764499:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782480832.764503:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c52cd800 from 7 10000000:01000000:0.0:1782480832.764507:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782480832.764572:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.764582:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.764597:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480832.764638:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165760:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782480832.764794:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480832.765344:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388165760 00000100:00100000:1.0:1782480832.765356:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388165760 00000100:00100000:1.0:1782480832.765448:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1782480832.765459:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388165760:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480832.765478:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480832.765496:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c167bc00/0x4776e02a9acf51dd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf51d6 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480832.765512:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495b40 going to sleep for 11 seconds 00010000:00010000:1.0:1782480832.765537:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167bc00/0x4776e02a9acf51dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf51d6 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480832.765550:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c167bc00/0x4776e02a9acf51dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf51d6 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480832.765561:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c167bc00, rc 0) 00000100:00100000:1.0:1782480832.765632:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388165760:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 174us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480832.765641:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:0.0:1782480832.766086:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165760:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480832.766108:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.766118:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480832.766215:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480832.766318:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480832.766352:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782480832.766388:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388165888 00000100:00100000:3.0:1782480832.766395:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388165888 00000100:00100000:3.0:1782480832.766436:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:3.0:1782480832.766445:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388165888:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480832.766954:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388165888:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 509us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480832.766962:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1782480832.766980:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388165888:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480832.767021:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388166016:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480832.767067:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480832.767130:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782480832.768405:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388166016 00000100:00100000:2.0:1782480832.768420:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388166016 00000100:00100000:2.0:1782480832.768598:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1782480832.768610:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388166016:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480832.769401:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388166016:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 790us (2330us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480832.769410:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:0.0:1782480832.769432:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388166016:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1782480832.771012:0:11066:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:0.0:1782480832.771903:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:0.0:1782480832.771937:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782480832.771958:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480832.771973:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480832.930774:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388166144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480832.930868:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480832.934054:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388166144 00000100:00100000:3.0:1782480832.934078:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388166144 00000100:00100000:3.0:1782480832.934199:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1782480832.934214:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388166144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480832.934269:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480832.934395:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388166144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 185us (3526us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480832.934403:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:3.0:1782480832.934472:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c12ae300 x1869066388166144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480848 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480832.934526:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388166144:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782480832.936786:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480833.003485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480833.003543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480833.003568:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480833.003754:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366107776 00000100:00100000:3.0:1782480833.003767:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366107776 00000100:00100000:3.0:1782480833.003847:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 251 00000100:00100000:3.0:1782480833.003860:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366107776:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480833.003972:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366107776:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 114us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480833.003981:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 251 00000100:00100000:3.0:1782480833.004040:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366107904 00000100:00100000:3.0:1782480833.004044:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366107904 00000100:00100000:3.0:1782480833.004085:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366108032 00000100:00100000:3.0:1782480833.004089:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366108032 00000100:00100000:3.0:1782480833.004111:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 105 00000100:00100000:3.0:1782480833.004117:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366107904:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480833.004153:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366107904:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 36us (690us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480833.004160:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 105 00000100:00100000:3.0:1782480833.004171:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:3.0:1782480833.004177:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366108032:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480833.004212:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366108032:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 35us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480833.004218:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00080000:3.0:1782480833.004242:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782480833.506390:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480834.532371:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480835.488521:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388166272:0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.488604:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480835.488725:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388166784:0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.488754:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480835.488782:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480835.488788:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388166656:0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.488813:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480835.491026:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388166400:0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.491918:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480835.491966:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388166912:0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.492010:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480835.492037:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480835.492043:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388166528:0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.492064:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480835.492345:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388166272 00000100:00100000:2.0:1782480835.492354:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388166272 00000100:00100000:2.0:1782480835.492417:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1782480835.492426:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388166272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.492484:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388166272:12345-0@lo:400:kworker.0 Request processed in 57us (3879us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480835.492492:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1782480835.492532:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388166656 00000100:00100000:2.0:1782480835.492536:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388166656 00000100:00100000:2.0:1782480835.492578:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388166912 00000100:00100000:2.0:1782480835.492581:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388166912 00000100:00100000:2.0:1782480835.492601:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782480835.492607:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388166656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.492641:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388166656:12345-0@lo:400:kworker.0 Request processed in 35us (3827us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480835.492647:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782480835.492682:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782480835.492689:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388166912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.492722:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388166912:12345-0@lo:400:kworker.0 Request processed in 34us (711us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480835.492728:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782480835.492746:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388166784 00000100:00100000:2.0:1782480835.492750:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388166784 00000100:00100000:2.0:1782480835.492780:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388166400 00000100:00100000:2.0:1782480835.492783:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388166400 00000100:00100000:2.0:1782480835.492795:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388166528 00000100:00100000:2.0:1782480835.492797:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388166528 00000100:00100000:2.0:1782480835.492814:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782480835.494355:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388166784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.494491:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388166784:12345-0@lo:400:kworker.0 Request processed in 192us (5736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480835.494521:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1782480835.494562:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782480835.494577:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388166400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.494619:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388166400:12345-0@lo:400:kworker.0 Request processed in 43us (3531us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480835.494637:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1782480835.494648:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782480835.494700:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388166528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.496353:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388166528:12345-0@lo:400:kworker.0 Request processed in 1688us (4277us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480835.496365:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00080000:2.0:1782480835.496408:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782480835.496413:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480835.496416:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480835.496470:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388166528:0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.496486:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388166400:0@lo:400:kworker.0 00010000:00080000:2.0:1782480835.496501:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ecea0000 x1869066388166912/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480835.496511:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388166912:0@lo:400:kworker.0 00010000:00080000:2.0:1782480835.496553:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ecea1180 x1869066388166656/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480851 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480835.496562:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388166656:0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.496573:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388166272:0@lo:400:kworker.0 00000100:00100000:2.0:1782480835.496599:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388166784:0@lo:400:kworker.0 00000100:00100000:0.0:1782480835.497224:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480835.497242:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388167040:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480835.497311:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480835.497812:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388167040 00000100:00100000:3.0:1782480835.497887:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388167040 00000100:00100000:3.0:1782480835.497940:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1782480835.497948:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388167040:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480835.497986:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480835.498036:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388167040:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (737us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480835.498043:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00010000:00080000:3.0:1782480835.498082:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c12ae300 x1869066388167040/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480851 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480835.498991:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388167040:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782480835.554247:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480836.577731:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1782480837.513901:0:11242:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782480837.598887:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480838.058779:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388167168:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480838.058863:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480838.061974:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388167168 00000100:00100000:0.0:1782480838.061990:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388167168 00000100:00100000:0.0:1782480838.062107:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1782480838.062120:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388167168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480838.062173:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480838.062686:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388167168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 544us (3796us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480838.062696:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:2.0:1782480838.062865:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1782480838.063141:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d8006bf100 x1869066388167168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480854 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480838.063169:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388167168:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480838.124295:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480838.124377:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480838.124414:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480838.124512:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366108416 00000100:00100000:0.0:1782480838.124522:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366108416 00000100:00100000:0.0:1782480838.124593:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366108288 00000100:00100000:0.0:1782480838.124597:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366108288 00000100:00100000:0.0:1782480838.124619:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 110 00000100:00100000:0.0:1782480838.124629:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366108416:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480838.124739:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366108416:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 111us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480838.124747:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 110 00000100:00100000:0.0:1782480838.124764:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 111 00000100:00100000:0.0:1782480838.124771:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366108288:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480838.124794:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366108288:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (380us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480838.124800:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 111 00000100:00100000:2.0:1782480838.124907:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366108160 00000100:00100000:2.0:1782480838.124913:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366108160 00000100:00100000:2.0:1782480838.124960:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 253 00000100:00100000:2.0:1782480838.124968:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366108160:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480838.124995:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366108160:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (710us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480838.125002:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 253 00000100:00080000:1.0:1782480838.125460:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782480838.622919:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480839.646849:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480840.607303:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388167296:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480840.607556:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480840.608548:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388167424:0@lo:400:kworker.0 00000100:00100000:3.0:1782480840.608618:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480840.608699:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388167936:0@lo:400:kworker.0 00000100:00100000:3.0:1782480840.608733:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480840.608778:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480840.608785:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388167552:0@lo:400:kworker.0 00000100:00100000:3.0:1782480840.609148:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480840.609281:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388167296 00000100:00100000:3.0:1782480840.609282:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388167936 00000100:00100000:0.0:1782480840.609302:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388167296 00000100:00100000:3.0:1782480840.609303:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388167936 00000100:00100000:3.0:1782480840.609412:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388167552 00000100:00100000:3.0:1782480840.609417:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388167552 00000100:00100000:3.0:1782480840.609442:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782480840.609451:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388167936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480840.609516:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1782480840.609525:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388167936:12345-0@lo:400:kworker.0 Request processed in 72us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480840.609534:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388167296:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480840.609552:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1782480840.609575:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782480840.609583:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388167552:12345-0@lo:400:kworker.0 00002000:00000024:0.0:1782480840.609585:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480840.609633:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388167552:12345-0@lo:400:kworker.0 Request processed in 49us (492us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480840.609640:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1782480840.609735:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388167552:0@lo:400:kworker.0 00000100:00100000:3.0:1782480840.609746:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388167936:0@lo:400:kworker.0 00000100:00100000:1.0:1782480840.609804:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388167680:0@lo:400:kworker.0 00000100:00100000:3.0:1782480840.609808:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388167424 00000100:00100000:3.0:1782480840.609816:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388167424 00000100:00100000:3.0:1782480840.609856:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1782480840.609865:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480840.609875:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388167424:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480840.609930:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388167424:12345-0@lo:400:kworker.0 Request processed in 67us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480840.609936:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1782480840.610214:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388167680 00000100:00100000:3.0:1782480840.610219:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388167680 00000100:00100000:3.0:1782480840.610249:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782480840.610255:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388167680:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480840.610289:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388167680:12345-0@lo:400:kworker.0 Request processed in 35us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480840.610295:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:3.0:1782480840.610431:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12ae680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388167424:0@lo:400:kworker.0 00000100:00100000:1.0:1782480840.611299:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12aea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388167680:0@lo:400:kworker.0 00000100:00100000:0.0:1782480840.612362:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388167296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2822us (4793us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480840.612380:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:0.0:1782480840.613069:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480840.613077:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480840.620222:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388167808:0@lo:400:kworker.0 00000100:00100000:2.0:1782480840.620316:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:2.0:1782480840.620401:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c12ae300 x1869066388167296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480856 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480840.620415:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388167808 00000100:00100000:2.0:1782480840.620425:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12ae300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388167296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480840.620439:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388167808 00000100:00100000:3.0:1782480840.620508:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1782480840.620521:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388167808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480840.620591:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388167808:12345-0@lo:400:kworker.0 Request processed in 73us (274us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480840.620599:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:2.0:1782480840.624098:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c12aca80 x1869066388167808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480856 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480840.624121:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c12aca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388167808:0@lo:400:kworker.0 00000100:00080000:0.0:1782480840.627191:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782480840.673947:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480841.694841:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782480842.238767:0:11342:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 09:34:00 (1782480840) === 00000100:00100000:2.0:1782480842.529183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480842.529291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480842.529374:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366108544 00000100:00100000:3.0:1782480842.529385:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366108544 00000100:00100000:3.0:1782480842.529476:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:3.0:1782480842.529488:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366108544:12345-192.168.201.58@tcp:41:mkdir.0 00000004:00000024:3.0:1782480842.529536:0:5803:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782480842.529638:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366108544:12345-192.168.201.58@tcp:41:mkdir.0 Request processed in 152us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480842.529646:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:3.0:1782480842.529703:0:5811:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366108672 00000100:00100000:3.0:1782480842.529707:0:5811:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366108672 00000100:00100000:3.0:1782480842.529731:0:5811:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1782480842.529737:0:5811:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:9651:x1869066366108672:12345-192.168.201.58@tcp:700:mkdir.0 00000100:00100000:3.0:1782480842.529776:0:5811:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:9651:x1869066366108672:12345-192.168.201.58@tcp:700:mkdir.0 Request processed in 39us (484us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480842.529784:0:5811:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00080000:2.0:1782480842.529853:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480842.542245:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480842.542634:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366108928 00000100:00100000:3.0:1782480842.542645:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366108928 00000100:00100000:3.0:1782480842.542779:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:3.0:1782480842.542801:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:9651:x1869066366108928:12345-192.168.201.58@tcp:36:mkdir.0 00010000:00010000:3.0:1782480842.542872:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480842.544124:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf50c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb96 expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.544154:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:3.0:1782480842.544165:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480842.552742:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf51e4 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.552767:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf51e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.552779:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf51e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.552810:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.552818:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.552825:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480842.555918:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782480842.555942:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf51e4 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.555955:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf51e4 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.555962:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf51e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.555968:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480842.555981:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf51e4 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.555990:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf51e4 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.556010:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:2.0:1782480842.556013:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480842.562891:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf51e4 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.562919:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf51e4 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480842.562949:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a96baa14 reply state 0000000058a8c360 transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480842.562960:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480842.563090:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:9651:x1869066366108928:12345-192.168.201.58@tcp:36:mkdir.0 Request processed in 20297us (20853us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1782480842.563100:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00010000:00010000:3.0:1782480842.582626:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.582645:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.582653:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.582686:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058c00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480842.582691:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.582699:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.582719:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91d7c610ba00) 00010000:00010000:3.0:1782480842.582722:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480842.582727:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.582733:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf51eb lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480842.598929:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480842.599711:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366109056 00000100:00100000:3.0:1782480842.599741:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366109056 00000100:00100000:3.0:1782480842.599800:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:3.0:1782480842.599809:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:9652:x1869066366109056:12345-192.168.201.58@tcp:101:chmod.0 00010000:00010000:3.0:1782480842.599831:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480842.599855:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf51f2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc1b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.600009:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf51f9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.600033:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf51f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.600045:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf51f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480842.600109:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:3.0:1782480842.600112:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480842.600150:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf51f9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.600176:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf51f2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc1b expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.600194:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf51f9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc1b expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.600202:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c51d1b00) 00010000:00010000:3.0:1782480842.600206:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480842.600209:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b600, rc 0) 00000100:00100000:3.0:1782480842.600291:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:9652:x1869066366109056:12345-192.168.201.58@tcp:101:chmod.0 Request processed in 483us (1383us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480842.600299:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:3.0:1782480842.603574:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480842.607598:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366109312 00000100:00100000:2.0:1782480842.607614:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366109312 00000100:00100000:2.0:1782480842.607801:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1782480842.607813:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:9652:x1869066366109312:12345-192.168.201.58@tcp:36:chmod.0 00010000:00010000:2.0:1782480842.607878:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480842.609604:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf51f9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc1b expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.609646:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c51d1b00) 00010000:00010000:2.0:1782480842.609689:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480842.609732:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.609747:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.609756:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480842.610281:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000baca1bdc reply state 00000000436bfa07 transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480842.610295:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1782480842.610314:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1782480842.610739:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:9652:x1869066366109312:12345-192.168.201.58@tcp:36:chmod.0 Request processed in 2923us (7170us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1782480842.610750:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00010000:00010000:3.0:1782480842.624561:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.624580:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.624588:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.624595:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480842.624599:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.624607:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.624625:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:3.0:1782480842.624627:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782480842.624632:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.624638:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5200 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480842.688069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480842.688190:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366109440 00000100:00100000:0.0:1782480842.688200:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366109440 00000100:00100000:0.0:1782480842.688260:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1782480842.688270:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:9653:x1869066366109440:12345-192.168.201.58@tcp:101:chown.0 00010000:00010000:0.0:1782480842.688295:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480842.688318:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5207 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc22 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.688393:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf520e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.688407:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf520e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.688420:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf520e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480842.688496:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782480842.688512:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480842.688560:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf520e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.688586:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5207 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc22 expref: 9 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.688603:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf520e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc22 expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.688611:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480842.688614:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480842.688617:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b400, rc 0) 00000100:00100000:0.0:1782480842.688729:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:9653:x1869066366109440:12345-192.168.201.58@tcp:101:chown.0 Request processed in 459us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480842.688737:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1782480842.694434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480842.694556:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366109568 00000100:00100000:3.0:1782480842.694571:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366109568 00000100:00100000:3.0:1782480842.694631:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:3.0:1782480842.694689:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:9653:x1869066366109568:12345-192.168.201.58@tcp:101:chown.0 00010000:00010000:3.0:1782480842.694711:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480842.694729:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5215 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc29 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.694787:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf521c lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.694799:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf521c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.694810:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf521c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.694826:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5223 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.694833:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.694840:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695410:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf522a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695419:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf522a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695427:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf522a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480842.695552:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:3.0:1782480842.695556:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480842.695587:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf522a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695599:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf521c lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695606:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf521c lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695613:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf521c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695619:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ac00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480842.695625:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf521c lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695632:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf521c lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695646:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480842.695649:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480842.695653:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf521c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695745:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf521c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695759:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5223 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695776:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5223 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695783:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5223 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695788:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779aa00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480842.695791:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5223 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695797:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5223 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695806:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91d7c51d1800) 00010000:00010000:3.0:1782480842.695809:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480842.695811:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5223 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695817:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5223 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695856:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5215 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc29 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695871:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf522a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc29 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.695878:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c51d1400) 00010000:00010000:3.0:1782480842.695880:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480842.695888:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779bc00, rc 0) 00000100:00100000:2.0:1782480842.696146:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:9653:x1869066366109568:12345-192.168.201.58@tcp:101:chown.0 Request processed in 1488us (1719us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480842.696157:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1782480842.701252:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480842.701360:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366109824 00000100:00100000:0.0:1782480842.701370:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366109824 00000100:00100000:0.0:1782480842.701434:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:0.0:1782480842.701445:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:9653:x1869066366109824:12345-192.168.201.58@tcp:36:chown.0 00010000:00010000:0.0:1782480842.701504:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480842.701532:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf522a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc29 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.701552:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c51d1400) 00010000:00010000:0.0:1782480842.701571:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480842.701598:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.701630:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.701640:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.722574:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00010000:0.0:1782480842.763490:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000023ff6993 reply state 00000000ac3881c9 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480842.763510:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782480842.763709:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1782480842.763823:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:9653:x1869066366109824:12345-192.168.201.58@tcp:36:chown.0 Request processed in 62375us (62575us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782480842.763831:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000001:00080000:3.0:1782480842.764052:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:0.0:1782480842.764757:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.764779:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.764788:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.764794:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480842.764799:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.764807:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.764823:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:0.0:1782480842.764837:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782480842.764843:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.764849:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5231 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480842.796354:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480842.797585:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366109952 00000100:00100000:2.0:1782480842.797597:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366109952 00000100:00100000:2.0:1782480842.797709:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:2.0:1782480842.797720:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:9654:x1869066366109952:12345-192.168.201.58@tcp:101:touch.500 00010000:00010000:2.0:1782480842.797744:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480842.797777:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5238 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc30 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782480842.803173:0:5802:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 5341us 00010000:00010000:3.0:1782480842.854229:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf523f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.854253:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf523f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.854265:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf523f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.854283:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5246 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.854301:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.854309:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.854806:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf524d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.854817:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf524d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.854824:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf524d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480842.854913:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782480842.854918:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480842.855007:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf524d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855038:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf523f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855045:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf523f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855053:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf523f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855059:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ae00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480842.855064:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf523f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855071:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf523f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855085:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480842.855088:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480842.855093:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf523f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855099:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf523f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855112:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5246 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855119:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5246 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855126:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855136:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779aa00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480842.855140:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5246 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855146:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5246 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855155:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91d7c51d1800) 00010000:00010000:3.0:1782480842.855157:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480842.855161:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5246 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855167:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5246 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855206:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf5238 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc30 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855223:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf524d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc30 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.855231:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:3.0:1782480842.855233:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782480842.855236:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ac00, rc 0) 00000100:00100000:3.0:1782480842.855308:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:9654:x1869066366109952:12345-192.168.201.58@tcp:101:touch.500 Request processed in 57589us (58965us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480842.855317:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1782480842.864038:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480842.864283:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366110208 00000100:00100000:2.0:1782480842.864293:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366110208 00000100:00100000:2.0:1782480842.864344:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:2.0:1782480842.864354:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:9654:x1869066366110208:12345-192.168.201.58@tcp:101:touch.500 00010000:00010000:2.0:1782480842.864376:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480842.864398:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf5254 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc37 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.864986:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf525b lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.865002:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf525b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.865024:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf525b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.865343:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.865354:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.865362:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782480842.876736:0:6840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:3.0:1782480842.877126:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5269 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877144:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877156:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5269 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877194:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf525b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877201:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf525b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877209:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf525b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877215:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480842.877220:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf525b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877227:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf525b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877241:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:3.0:1782480842.877244:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480842.877249:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf525b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877255:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d802059400/0x4776e02a9acf525b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480842.877286:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000006ebc7f5c reply state 000000009de5f2da transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480842.877297:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782480842.877336:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d802058c00/0x4776e02a9acf5254 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc37 expref: 10 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877353:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5269 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc37 expref: 9 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.877361:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91d7c51d1800) 00010000:00010000:3.0:1782480842.877363:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480842.877366:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779aa00, rc 0) 00000100:00100000:3.0:1782480842.877445:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:9654:x1869066366110208:12345-192.168.201.58@tcp:101:touch.500 Request processed in 13092us (13432us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1782480842.877454:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00010000:00010000:2.0:1782480842.882269:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.882302:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.882311:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.882318:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0030200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480842.882323:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.882333:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.882352:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x99b180b8 (ffff91d7c610b500) 00010000:00010000:2.0:1782480842.882356:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480842.882362:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.882369:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf5262 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480842.891503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480842.891696:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366110464 00000100:00100000:2.0:1782480842.891707:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366110464 00000100:00100000:2.0:1782480842.891780:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:2.0:1782480842.891790:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:9654:x1869066366110464:12345-192.168.201.58@tcp:36:touch.500 00010000:00010000:2.0:1782480842.891860:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480842.891895:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf5269 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc37 expref: 9 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.891942:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91d7c51d1800) 00010000:00010000:2.0:1782480842.891963:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480842.892024:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.892038:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480842.892048:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480842.892191:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000057dc5ce5 reply state 00000000114ef6f8 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480842.892202:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480842.892334:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:9654:x1869066366110464:12345-192.168.201.58@tcp:36:touch.500 Request processed in 544us (840us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782480842.892342:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:1.0:1782480842.894926:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:0.0:1782480842.895034:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.895047:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.895055:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.895061:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0030400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480842.895066:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.895073:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.895091:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91d7c610b700) 00010000:00010000:0.0:1782480842.895094:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480842.895099:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480842.895106:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf5277 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480842.895707:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366110592 00000100:00100000:3.0:1782480842.895718:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366110592 00000100:00100000:3.0:1782480842.895776:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:3.0:1782480842.895786:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:9654:x1869066366110592:12345-192.168.201.58@tcp:101:touch.500 00010000:00010000:3.0:1782480842.895809:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480842.895829:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf527e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc3e expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.895894:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf527e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc3e expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.895926:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf527e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc3e expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480842.895943:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91d7c51d1400) 00010000:00010000:3.0:1782480842.895946:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480842.895949:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ae00, rc 0) 00000100:00100000:3.0:1782480842.896019:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:9654:x1869066366110592:12345-192.168.201.58@tcp:101:touch.500 Request processed in 226us (1095us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480842.896027:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:1.0:1782480842.899322:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480842.899380:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366110720 00000100:00100000:2.0:1782480842.899391:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366110720 00000100:00100000:2.0:1782480842.899450:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:2.0:1782480842.899459:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2349:x1869066366110720:12345-192.168.201.58@tcp:8:touch.500 00010000:00080000:2.0:1782480842.899494:0:8498:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp t0 exp 0000000000000000 cur 373 last 0 00000020:00000080:2.0:1782480842.899523:0:8498:0:(genops.c:1406:class_connect()) connect: client 227f6c69-cfd7-4cc4-bae6-15b91431c78c, cookie 0x4776e02a9acf5285 00002000:00100000:2.0:1782480842.899535:0:8498:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 227f6c69-cfd7-4cc4-bae6-15b91431c78c/ffff91d7c4a8f800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782480842.899563:0:8498:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782480842.899882:0:8498:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782480842.899911:0:8498:0:(import.c:65:import_set_state_nolock()) ffff91d7c4a8e000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480842.899990:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2349:x1869066366110720:12345-192.168.201.58@tcp:8:touch.500 Request processed in 530us (675us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480842.899998:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1782480842.906512:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480842.906592:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366110848 00000100:00100000:2.0:1782480842.906604:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366110848 00000100:00100000:2.0:1782480842.906739:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1782480842.906752:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:0:x1869066366110848:12345-192.168.201.58@tcp:2:touch.500 00000100:00080000:0.0:1782480842.907298:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480843.046682:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:0:x1869066366110848:12345-192.168.201.58@tcp:2:touch.500 Request processed in 139906us (140156us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1782480843.046696:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000001:00080000:0.0:1782480843.046850:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00100000:0.0:1782480843.046871:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000100:00100000:1.0:1782480843.055639:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480843.056102:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366111104 00000100:00100000:0.0:1782480843.056113:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366111104 00000100:00100000:2.0:1782480843.056279:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1782480843.056290:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:9654:x1869066366111104:12345-192.168.201.58@tcp:35:touch.500 00000100:00100000:2.0:1782480843.057082:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+11:9654:x1869066366111104:12345-192.168.201.58@tcp:35:touch.500 Request processed in 720us (1438us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782480843.057093:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:1.0:1782480843.071116:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480843.071195:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366111232 00000100:00100000:3.0:1782480843.071205:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366111232 00000100:00100000:3.0:1782480843.071263:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:3.0:1782480843.071273:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+11:9655:x1869066366111232:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:3.0:1782480843.071296:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480843.071316:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf528c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc45 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.071383:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5293 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.071397:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.071408:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480843.071755:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782480843.071773:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480843.071821:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5293 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.071852:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf528c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc45 expref: 13 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.071872:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5293 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc45 expref: 12 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.071881:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:3.0:1782480843.072078:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480843.072082:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b400, rc 0) 00000100:00100000:0.0:1782480843.072496:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:9655:x1869066366111232:12345-192.168.201.58@tcp:101:rm.0 Request processed in 1221us (1390us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480843.072505:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:1.0:1782480843.075516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480843.075612:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366111488 00000100:00100000:3.0:1782480843.075623:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366111488 00000100:00100000:3.0:1782480843.075709:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:3.0:1782480843.075719:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:9655:x1869066366111488:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:3.0:1782480843.075743:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480843.076223:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf529a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc4c expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480843.076351:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:3.0:1782480843.076535:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf529a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc4c expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.076550:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480843.076553:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480843.076558:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779aa00/0x4776e02a9acf529a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc4c expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.076586:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779aa00, rc 0) 00000100:00100000:3.0:1782480843.077408:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:9655:x1869066366111488:12345-192.168.201.58@tcp:101:rm.0 Request processed in 942us (1155us total) trans 4294967303 rc 301/301 00000100:00100000:3.0:1782480843.077417:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:1.0:1782480843.082174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480843.082361:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366111616 00000100:00100000:0.0:1782480843.082372:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366111616 00000100:00100000:0.0:1782480843.082433:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:0.0:1782480843.082444:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:9655:x1869066366111616:12345-192.168.201.58@tcp:37:rm.0 00000100:00100000:2.0:1782480843.094165:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:9655:x1869066366111616:12345-192.168.201.58@tcp:37:rm.0 Request processed in 11705us (11982us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480843.094181:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:3.0:1782480843.101808:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480843.102059:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366111872 00000100:00100000:2.0:1782480843.102070:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366111872 00000100:00100000:2.0:1782480843.102134:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:2.0:1782480843.102145:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:9655:x1869066366111872:12345-192.168.201.58@tcp:35:rm.0 00000100:00100000:2.0:1782480843.102418:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b67c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:9655:x1869066366111872:12345-192.168.201.58@tcp:35:rm.0 Request processed in 275us (619us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1782480843.102438:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:1.0:1782480843.116151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480843.122772:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366112128 00000100:00100000:2.0:1782480843.122788:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366112128 00000100:00100000:2.0:1782480843.122866:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:2.0:1782480843.122877:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:9655:x1869066366112128:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:2.0:1782480843.123257:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480843.123282:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52a8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc53 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.123412:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf52af lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.123426:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf52af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.123450:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf52af lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480843.123462:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782480843.123641:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52a8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc53 expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.124532:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf52af lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc53 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.124543:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:2.0:1782480843.124546:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782480843.124550:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0031200, rc 0) 00000100:00100000:2.0:1782480843.124634:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:9655:x1869066366112128:12345-192.168.201.58@tcp:101:rm.0 Request processed in 1758us (8494us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782480843.124645:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:1.0:1782480843.133644:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480843.138573:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366112256 00000100:00100000:0.0:1782480843.138592:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366112256 00000100:00100000:0.0:1782480843.138800:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:0.0:1782480843.138812:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:9655:x1869066366112256:12345-192.168.201.58@tcp:41:rm.0 00000004:00000024:1.0:1782480843.139639:0:6840:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:1.0:1782480843.139769:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:9655:x1869066366112256:12345-192.168.201.58@tcp:41:rm.0 Request processed in 947us (6123us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480843.139779:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:1.0:1782480843.147459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480843.147555:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366112384 00000100:00100000:0.0:1782480843.147566:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366112384 00000100:00100000:0.0:1782480843.147628:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:0.0:1782480843.147638:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:9655:x1869066366112384:12345-192.168.201.58@tcp:101:rm.0 00010000:00010000:0.0:1782480843.147688:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480843.147711:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf52bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc5a expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.147796:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf52c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.147812:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf52c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.147845:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf52c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.147873:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf52cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.148064:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf52cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.148074:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf52cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155200:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167ba00/0x4776e02a9acf52d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155221:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167ba00/0x4776e02a9acf52d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155234:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167ba00/0x4776e02a9acf52d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480843.155268:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782480843.155272:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480843.155290:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167ba00/0x4776e02a9acf52d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155301:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167ba00/0x4776e02a9acf52d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155327:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf52c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155334:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf52c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155342:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf52c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155347:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480843.155351:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf52c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155358:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf52c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155369:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:1.0:1782480843.155372:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480843.155376:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf52c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155381:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf52c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155398:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf52cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155405:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf52cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155411:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf52cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155419:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480843.155422:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf52cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155428:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf52cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155434:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x99b180b8 (ffff91d7c32f3900) 00010000:00010000:1.0:1782480843.155436:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480843.155439:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf52cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155444:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf52cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155487:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf52bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc5a expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155503:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167ba00/0x4776e02a9acf52d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc5a expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480843.155509:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91d7c51d1400) 00010000:00010000:1.0:1782480843.155511:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480843.155513:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c167ba00, rc 0) 00000100:00100000:1.0:1782480843.155698:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+17:9655:x1869066366112384:12345-192.168.201.58@tcp:101:rm.0 Request processed in 8022us (8220us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480843.155708:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:0.0:1782480843.167221:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480843.167246:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388168064:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480843.167325:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480843.167463:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388168064 00000100:00100000:2.0:1782480843.167472:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388168064 00000100:00100000:2.0:1782480843.167539:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1782480843.167548:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388168064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480843.167572:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480843.167617:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388168064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 70us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480843.167624:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:0.0:1782480843.168990:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1782480843.169073:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7c528ce00 x1869066388168064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480859 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480843.169097:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388168064:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480843.171765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480843.171894:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366112640 00000100:00100000:2.0:1782480843.171905:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366112640 00000100:00100000:2.0:1782480843.171964:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:2.0:1782480843.171973:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+17:9655:x1869066366112640:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:2.0:1782480843.172040:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782480843.172069:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167ba00/0x4776e02a9acf52d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc5a expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172092:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf527e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc3e expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172103:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91d7c51d1400) 00010000:00010000:2.0:1782480843.172123:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5293 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc45 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172131:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:2.0:1782480843.172142:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480843.172164:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52d9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172177:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172187:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172200:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172206:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172212:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172351:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf52e7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172367:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf52e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.172374:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf52e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480843.173225:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1782480843.173239:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 373734579672ns, next at 374734577115ns, rc = 0 00010000:00010000:2.0:1782480843.173314:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173335:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173344:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173354:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173359:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173366:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173382:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480843.173403:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf52e7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173410:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf52e7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173415:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf52e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173421:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0030400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480843.173426:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf52e7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173433:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf52e7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173453:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91d7c610b500) 00010000:00010000:2.0:1782480843.173455:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782480843.173460:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf52e7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173465:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf52e7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173484:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52d9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173490:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52d9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173496:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173500:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0030200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480843.173504:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52d9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173509:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52d9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173517:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:2.0:1782480843.173519:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480843.173522:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52d9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.173528:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf52d9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480843.173548:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000af808d28 reply state 00000000fb23afca transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480843.173558:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480843.173652:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:9655:x1869066366112640:12345-192.168.201.58@tcp:36:rm.0 Request processed in 1676us (1904us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782480843.173704:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00010000:00010000:0.0:1782480843.174264:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480843.174273:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.174280:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d600 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480843.174283:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.174290:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.174315:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff91d7c610b500) 00010000:00010000:0.0:1782480843.174317:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782480843.174321:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.174327:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf52ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.174344:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480843.174347:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480843.174348:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480843.180310:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.180328:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.180336:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.180343:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0031a00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480843.180348:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.180357:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.180374:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x99b180b8 (ffff91d7c610b100) 00010000:00010000:3.0:1782480843.180378:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480843.180382:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480843.180388:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf52e0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x99b180b8 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480843.180577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480843.180695:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366112896 00000100:00100000:0.0:1782480843.180705:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366112896 00000100:00100000:0.0:1782480843.180748:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:0.0:1782480843.180767:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:9655:x1869066366112896:12345-192.168.201.58@tcp:35:rm.0 00000100:00100000:0.0:1782480843.181104:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:9655:x1869066366112896:12345-192.168.201.58@tcp:35:rm.0 Request processed in 346us (531us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1782480843.181113:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1782480843.185955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480843.187490:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366113152 00000100:00100000:2.0:1782480843.187504:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366113152 00000100:00100000:2.0:1782480843.187577:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:2.0:1782480843.187589:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:9655:x1869066366113152:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:2.0:1782480843.187691:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1782480843.187727:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf52af lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc53 expref: 16 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.187764:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf524d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc30 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.187777:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:2.0:1782480843.187798:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf520e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc22 expref: 14 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.187811:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:2.0:1782480843.187819:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480843.187859:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf52f5 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.188189:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf52f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.188202:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf52f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.188219:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.188226:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.188233:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.188561:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf5303 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.188570:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf5303 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.188579:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf5303 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480843.191735:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:2.0:1782480843.191768:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf5303 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.191779:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf5303 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.191787:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf5303 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.191801:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2dc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480843.191806:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf5303 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.191813:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf5303 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.191830:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff91d7c610b700) 00010000:00010000:2.0:1782480843.191833:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782480843.191838:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf5303 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.191844:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf5303 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.192131:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf52f5 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.192140:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf52f5 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.192146:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf52f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.192150:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2cc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480843.192154:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf52f5 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.192160:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf52f5 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.192181:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b000) 00010000:00010000:2.0:1782480843.192183:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480843.192187:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf52f5 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480843.192193:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf52f5 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480843.192206:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000004bf94aac reply state 000000001e4c1046 transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480843.192215:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480843.192320:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:9655:x1869066366113152:12345-192.168.201.58@tcp:36:rm.0 Request processed in 4728us (6370us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1782480843.192330:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00010000:00010000:0.0:1782480843.195457:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.195479:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.195487:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.195494:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2ca00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480843.195500:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.195527:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.195546:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff91d7c610b500) 00010000:00010000:0.0:1782480843.195549:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480843.195553:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480843.195560:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf52fc lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480843.254240:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480843.254488:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480843.255198:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366113408 00000100:00100000:2.0:1782480843.255210:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366113408 00000100:00100000:2.0:1782480843.255326:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:2.0:1782480843.255338:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366113408:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480843.255453:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366113408:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 117us (1225us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480843.255462:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00080000:1.0:1782480843.257216:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480843.266211:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366113280 00000100:00100000:0.0:1782480843.266226:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366113280 00000100:00100000:1.0:1782480843.273415:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 255 00000100:00100000:1.0:1782480843.273433:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366113280:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480843.273681:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366113280:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 231us (19172us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480843.273690:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 255 00010000:00010000:0.0:1782480843.751017:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480844.770150:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480845.727147:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388168192:0@lo:400:kworker.0 00000100:00100000:3.0:1782480845.727223:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480845.727283:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388168704:0@lo:400:kworker.0 00000100:00100000:3.0:1782480845.728814:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480845.728882:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782480845.728894:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388168320:0@lo:400:kworker.0 00000100:00100000:1.0:1782480845.730630:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388168192 00000100:00100000:1.0:1782480845.730646:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388168192 00000100:00100000:1.0:1782480845.730752:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1782480845.730765:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388168192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480845.730863:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388168192:12345-0@lo:400:kworker.0 Request processed in 101us (3640us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480845.730870:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1782480845.730914:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388168704 00000100:00100000:1.0:1782480845.730918:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388168704 00000100:00100000:1.0:1782480845.730956:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:1.0:1782480845.730977:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388168704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480845.731012:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388168704:12345-0@lo:400:kworker.0 Request processed in 51us (2205us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480845.731018:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00080000:1.0:1782480845.731039:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480845.732739:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388168448:0@lo:400:kworker.0 00000100:00100000:0.0:1782480845.732824:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480845.732856:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388168960:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480845.732880:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480845.732917:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480845.732925:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388168576:0@lo:400:kworker.0 00000100:00100000:0.0:1782480845.732950:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480845.733035:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388168448 00000100:00100000:0.0:1782480845.733276:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388168448 00000100:00100000:0.0:1782480845.733403:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782480845.733413:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388168448:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480845.733514:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388168448:12345-0@lo:400:kworker.0 Request processed in 103us (690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480845.733537:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1782480845.733565:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388168960 00000100:00100000:0.0:1782480845.733569:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388168960 00000100:00100000:0.0:1782480845.733600:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782480845.733608:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388168960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480845.733638:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480845.733697:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388168960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (814us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480845.733703:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1782480845.733721:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388168576 00000100:00100000:0.0:1782480845.733724:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388168576 00000100:00100000:0.0:1782480845.733752:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782480845.733759:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388168576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480845.733789:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388168576:12345-0@lo:400:kworker.0 Request processed in 31us (838us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480845.733794:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:0.0:1782480845.733928:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480845.733932:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480845.733934:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1782480845.736579:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4a9500 x1869066388168576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480845.736600:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388168576:0@lo:400:kworker.0 00000100:00100000:0.0:1782480845.736618:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388168448:0@lo:400:kworker.0 00010000:00080000:0.0:1782480845.736630:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4ab100 x1869066388168960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480861 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480845.736834:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388168960:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480845.741952:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480845.742005:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388168320 00000100:00100000:3.0:1782480845.742014:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388168320 00000100:00100000:3.0:1782480845.742542:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1782480845.742557:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388168320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480845.742626:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388168320:12345-0@lo:400:kworker.0 Request processed in 74us (680us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480845.742633:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1782480845.747409:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388168320:0@lo:400:kworker.0 00000100:00100000:2.0:1782480845.747435:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388168832:0@lo:400:kworker.0 00000100:00100000:2.0:1782480845.749189:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480845.749263:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388168192:0@lo:400:kworker.0 00000100:00100000:1.0:1782480845.749823:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388168832 00000100:00100000:1.0:1782480845.749832:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388168832 00000100:00100000:1.0:1782480845.750128:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782480845.750148:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388168832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480845.750218:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388168832:12345-0@lo:400:kworker.0 Request processed in 74us (1033us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480845.750225:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782480845.750395:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388168704:0@lo:400:kworker.0 00010000:00080000:2.0:1782480845.750434:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4ab480 x1869066388168832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480861 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480845.751371:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388168832:0@lo:400:kworker.0 00010000:00010000:0.0:1782480845.808061:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480846.815000:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480847.840375:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782480847.896708:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000001:00080000:3.0:1782480847.896731:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000004:00080000:3.0:1782480847.896738:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000100:00100000:0.0:1782480847.897156:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480847.897175:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388169088:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782480847.897257:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480847.897322:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388169088 00000100:00100000:0.0:1782480847.897329:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388169088 00000100:00100000:0.0:1782480847.897383:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782480847.897391:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388169088:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1782480847.897418:0:8498:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1782480847.897451:0:8498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a3e7fcb, atime: 0x6a3e7fcb, ctime: 0x6a3e7fcb, blocks: 0x1 00010000:00010000:0.0:1782480847.897459:0:8498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c816f959/0x4776e02a9acf530a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.897476:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=378s v=(0 0) 00010000:00010000:0.0:1782480847.897481:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480847.897487:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c816f959/0x4776e02a9acf530a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.897504:0:8498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c816f959/0x4776e02a9acf530a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.897516:0:8498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c816f959/0x4776e02a9acf530a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.897536:0:8498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c816f959/0x4776e02a9acf530a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.897552:0:8498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782480847.899317:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388169088:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1922us (2055us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782480847.899326:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:0.0:1782480847.899355:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782480847.899371:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480847.899378:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c816f959/0x4776e02a9acf530a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.899388:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480847.899392:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c816f959/0x4776e02a9acf530a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.899403:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c816f959/0x4776e02a9acf530a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.899421:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c816f959/0x4776e02a9acf530a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.899428:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c816f959/0x4776e02a9acf530a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480847.899459:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480847.899461:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480847.899462:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1782480847.900997:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7df4c8000/2, rc 0, transno 4294967300 00000100:00100000:2.0:1782480847.901011:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388169088:0@lo:6:osp-syn-0-0.0 00000001:02000400:2.0:1782480847.964540:0:11495:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00000100:00100000:0.0:1782480848.288107:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388169216:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480848.288180:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480848.295449:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388169216 00000100:00100000:0.0:1782480848.295462:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388169216 00000100:00100000:0.0:1782480848.295521:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782480848.295533:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388169216:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480848.295576:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480848.295656:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388169216:12345-0@lo:13:osp-pre-0-0.0 Request processed in 125us (7475us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480848.295680:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782480848.295738:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388169216:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480848.364564:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480848.364610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480848.364638:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480848.364687:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480848.364716:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366113536 00000100:00100000:3.0:1782480848.364725:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366113536 00000100:00100000:3.0:1782480848.364790:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 257 00000100:00100000:3.0:1782480848.364801:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366113536:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480848.364889:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366113536:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 90us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480848.364897:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 257 00000100:00100000:3.0:1782480848.364941:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366113792 00000100:00100000:3.0:1782480848.364945:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366113792 00000100:00100000:3.0:1782480848.364983:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:3.0:1782480848.364990:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2352:x1869066366113792:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480848.365017:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2352:x1869066366113792:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480848.365022:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00080000:3.0:1782480848.365123:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480848.365210:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366113664 00000100:00100000:0.0:1782480848.365215:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366113664 00000100:00100000:0.0:1782480848.365249:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366113920 00000100:00100000:0.0:1782480848.365252:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366113920 00000100:00100000:0.0:1782480848.365272:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:0.0:1782480848.365279:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2352:x1869066366113664:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480848.365316:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2352:x1869066366113664:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 37us (762us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480848.365322:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:0.0:1782480848.365333:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:0.0:1782480848.365339:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366113920:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480848.365365:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366113920:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (763us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480848.365371:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00080000:0.0:1782480848.365383:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:0.0:1782480848.379357:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00010000:00010000:0.0:1782480848.871043:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1782480849.172600:0:11545:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc6a6bb8f0 20000000:00000080:1.0:1782480849.172618:0:11545:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d7ecc53400 uarg=0000000000000000 20000000:01000000:1.0:1782480849.172655:0:11545:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1782480849.172809:0:11545:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:1.0:1782480849.172815:0:11545:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:3.0:1782480849.173574:0:11546:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:1.0:1782480849.173915:0:11545:0:(mgs_llog.c:4111:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:1.0:1782480849.185138:0:11545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:1.0:1782480849.185241:0:11545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:1.0:1782480849.185309:0:11545:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:1.0:1782480849.185400:0:11545:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782480849.185424:0:11545:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.185445:0:11545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc0d expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.185453:0:11545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d6c297b800/0x4776e02a9acf51b3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc14 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.185461:0:11545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c779a000/0x4776e02a9acf51c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf51ba expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.185467:0:11545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802058000/0x4776e02a9acf51cf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf51c8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.185473:0:11545:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c167bc00/0x4776e02a9acf51dd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf51d6 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.185493:0:11545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.185534:0:11545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c167bc00/0x4776e02a9acf51dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf51d6 expref: 18 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.185547:0:11545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c167bc00/0x4776e02a9acf51dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf51d6 expref: 18 pid: 5794 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480849.185562:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869066388169344:0@lo:104: 00000100:00100000:1.0:1782480849.185634:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782480849.185710:0:11545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802058000/0x4776e02a9acf51cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf51c8 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.185719:0:11545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d802058000/0x4776e02a9acf51cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf51c8 expref: 18 pid: 5797 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480849.185727:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869066388169472:0@lo:104: 00000100:00100000:1.0:1782480849.185751:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480849.185783:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388169344 00000100:00100000:1.0:1782480849.185790:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388169344 00000100:00100000:1.0:1782480849.185840:0:5785:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388169472 00000100:00100000:1.0:1782480849.185843:0:5785:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388169472 00000100:00100000:1.0:1782480849.185858:0:5785:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782480849.185866:0:5785:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:11545:x1869066388169344:12345-0@lo:104: 00010000:00010000:1.0:1782480849.185877:0:5785:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480849.185985:0:5784:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480849.185994:0:5784:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:11545:x1869066388169472:12345-0@lo:104: 00010000:00010000:2.0:1782480849.186002:0:5784:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.186192:0:5785:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1782480849.186206:0:5785:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+4:11545:x1869066388169344:12345-0@lo:104: Request processed in 340us (572us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480849.186215:0:5785:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1782480849.186259:0:11545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c779a000/0x4776e02a9acf51c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf51ba expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.186268:0:11545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff91d7c779a000/0x4776e02a9acf51c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf51ba expref: 18 pid: 5797 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480849.186276:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869066388169600:0@lo:104: 00000100:00100000:1.0:1782480849.186301:0:11545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782480849.186397:0:11545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d6c297b800/0x4776e02a9acf51b3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc14 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.186407:0:11545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d6c297b800/0x4776e02a9acf51b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc14 expref: 12 pid: 5796 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480849.186416:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869066388169728:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480849.186473:0:11545:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc0d expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.186482:0:11545:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc0d expref: 12 pid: 5794 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480849.186491:0:11545:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869066388169856:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480849.186619:0:11545:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c99f5240 going to sleep for 11 seconds 00000100:00100000:1.0:1782480849.186642:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a9880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869066388169344:0@lo:104: 00000100:00100000:1.0:1782480849.186650:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4aa300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869066388169472:0@lo:104: 00010000:00010000:2.0:1782480849.189211:0:5784:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1782480849.189230:0:5784:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:11545:x1869066388169472:12345-0@lo:104: Request processed in 3233us (3473us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480849.189240:0:5784:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00010000:0.0:1782480849.192312:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782480849.192327:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192340:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b600 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480849.192345:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192358:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480849.192367:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480849.192374:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782480849.192433:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192439:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480849.192472:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192481:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d6c297b600/0x4776e02a9acf51d6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf51dd expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192526:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480849.192529:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192534:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059c00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480849.192537:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192544:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480849.192550:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480849.192554:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782480849.192569:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192574:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480849.192591:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192597:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d802059c00/0x4776e02a9acf51c8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf51cf expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192608:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480849.192610:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480849.192612:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480849.192630:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388169984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480849.192717:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480849.192778:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388170112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480849.192808:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480849.192844:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388169984 00000100:00100000:0.0:1782480849.192850:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388169984 00010000:00010000:0.0:1782480849.192876:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c167bc00/0x4776e02a9acf51dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf51d6 expref: 19 pid: 5794 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480849.192914:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388170112 00000100:00100000:0.0:1782480849.192918:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388170112 00010000:00010000:0.0:1782480849.192932:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802058000/0x4776e02a9acf51cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf51c8 expref: 20 pid: 5797 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480849.192951:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782480849.192959:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+20:3311:x1869066388169984:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480849.192974:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480849.192980:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c167bc00/0x4776e02a9acf51dd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf51d6 expref: 20 pid: 5794 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.192993:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c167bc00/0x4776e02a9acf51dd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf51d6 expref: 20 pid: 5794 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.193008:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167bc00/0x4776e02a9acf51dd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf51d6 expref: 20 pid: 5794 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.193021:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480849.193061:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388169984:12345-0@lo:103:ldlm_bl.0 Request processed in 102us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480849.193069:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1782480849.193100:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480849.193109:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3312:x1869066388170112:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480849.193116:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480849.193132:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802058000/0x4776e02a9acf51cf lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf51c8 expref: 18 pid: 5797 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.193140:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802058000/0x4776e02a9acf51cf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf51c8 expref: 18 pid: 5797 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.193149:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802058000/0x4776e02a9acf51cf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf51c8 expref: 18 pid: 5797 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.193158:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480849.193181:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3312:x1869066388170112:12345-0@lo:103:ldlm_bl.0 Request processed in 75us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480849.193186:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480849.193221:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388170112:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480849.193242:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388169984:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480849.196168:0:8323:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1782480849.196196:0:8323:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388169600 00000100:00100000:0.0:1782480849.196203:0:8323:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388169600 00000100:00100000:0.0:1782480849.196296:0:8323:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782480849.196305:0:8323:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef008050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:11545:x1869066388169600:12345-0@lo:104: 00010000:00010000:0.0:1782480849.196322:0:8323:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.196421:0:8323:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1782480849.196427:0:8323:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef008050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+3:11545:x1869066388169600:12345-0@lo:104: Request processed in 124us (10125us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480849.196446:0:8323:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782480849.196567:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ab800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869066388169600:0@lo:104: 00010000:00010000:3.0:1782480849.197219:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480849.197227:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480849.197235:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059800 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480849.197239:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480849.197248:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480849.197255:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480849.197260:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1782480849.199242:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480849.199258:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480849.199285:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480849.199293:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d802059800/0x4776e02a9acf51ba lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf51c1 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480849.199337:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480849.199339:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480849.199341:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480849.199558:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480849.199580:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388170240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480849.199683:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480849.199800:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388170240 00000100:00100000:1.0:1782480849.199815:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388170240 00010000:00010000:1.0:1782480849.199849:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c779a000/0x4776e02a9acf51c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf51ba expref: 17 pid: 5797 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480849.199882:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782480849.199892:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d1301850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3313:x1869066388170240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782480849.199940:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480849.199946:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c779a000/0x4776e02a9acf51c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf51ba expref: 17 pid: 5797 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.199959:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c779a000/0x4776e02a9acf51c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf51ba expref: 17 pid: 5797 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.199974:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779a000/0x4776e02a9acf51c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf51ba expref: 17 pid: 5797 timeout: 529 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.199988:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480849.200027:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d1301850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3313:x1869066388170240:12345-0@lo:103:ldlm_bl.0 Request processed in 137us (372us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480849.200034:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782480849.201500:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388170240:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480849.202496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480849.202544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480849.202615:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366114176 00000100:00100000:1.0:1782480849.202623:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366114176 00010000:00010000:1.0:1782480849.202687:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc0d expref: 13 pid: 5794 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480849.202722:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366114048 00000100:00100000:1.0:1782480849.202725:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366114048 00010000:00010000:1.0:1782480849.202738:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d6c297b800/0x4776e02a9acf51b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc14 expref: 14 pid: 5796 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480849.202752:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1782480849.202768:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+14:2350:x1869066366114176:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480849.202782:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480849.202789:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc0d expref: 14 pid: 5794 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.202799:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc0d expref: 14 pid: 5794 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.202817:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480849.202872:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aa680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+14:2350:x1869066366114176:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 105us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480849.202880:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:1.0:1782480849.202913:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:1.0:1782480849.202919:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366114048:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480849.202927:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480849.202931:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d6c297b800/0x4776e02a9acf51b3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc14 expref: 13 pid: 5796 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.202941:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d6c297b800/0x4776e02a9acf51b3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc14 expref: 13 pid: 5796 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.202954:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.202963:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.202977:0:5786:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.202991:0:5786:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.202998:0:5786:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.203005:0:5786:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.203012:0:5786:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167ba00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782480849.203016:0:5786:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.203024:0:5786:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.203033:0:5786:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480849.203042:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480849.203065:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366114048:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 146us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480849.203071:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00010000:00010000:2.0:1782480849.208994:0:11545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297b800/0x4776e02a9acf51b3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc14 expref: 12 pid: 5796 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480849.209020:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4aaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869066388169728:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480849.209297:0:11545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297ba00/0x4776e02a9acf51ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc0d expref: 11 pid: 5794 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480849.209311:0:11545:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11545:1869066388169856:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480849.209353:0:11545:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480849.209364:0:11545:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480849.209369:0:11545:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480849.209375:0:11545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf5311 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11545 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480849.887416:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782480850.526784:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782480850.526794:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d6c29a2000 from 7 10000000:01000000:1.0:1782480850.526799:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480850.526855:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480850.526866:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480850.526925:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480850.526956:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388170368:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782480850.527033:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480850.527118:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c99f5000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480850.527519:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388170368 00000100:00100000:2.0:1782480850.527528:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388170368 00000100:00100000:2.0:1782480850.527650:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1782480850.527690:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:5799:x1869066388170368:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480850.527707:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480850.527734:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2c000/0x4776e02a9acf531f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5318 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480850.527760:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2c000/0x4776e02a9acf531f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5318 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480850.527772:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2c000/0x4776e02a9acf531f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5318 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480850.527789:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2c000, rc 0) 00000100:00100000:2.0:1782480850.527847:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388170368:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 188us (813us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480850.527854:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1782480850.527957:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388170368:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480850.527974:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480850.527985:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480850.528048:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388170496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480850.528079:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480850.528979:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c99f5000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480850.528996:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388170496 00000100:00100000:3.0:1782480850.529003:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388170496 00000100:00100000:3.0:1782480850.529033:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1782480850.529041:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388170496:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480850.529310:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388170496:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 269us (1229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480850.529316:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1782480850.529405:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388170496:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480850.529446:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388170624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480850.529488:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480850.529515:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c99f5000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480850.529734:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388170624 00000100:00100000:3.0:1782480850.529738:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388170624 00000100:00100000:3.0:1782480850.529759:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:3.0:1782480850.529766:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388170624:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480850.529932:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388170624:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 166us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480850.529945:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1782480850.529967:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388170624:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480850.530867:0:11558:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11558:1869066388170752:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480850.530929:0:11558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480850.530970:0:11558:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c99f5240 going to sleep for 11 seconds 00000100:00100000:3.0:1782480850.531030:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388170752 00000100:00100000:3.0:1782480850.531036:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388170752 00000100:00100000:3.0:1782480850.531062:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:3.0:1782480850.531069:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:11558:x1869066388170752:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480850.531248:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:11558:x1869066388170752:12345-0@lo:502:llog_process_th.0 Request processed in 178us (317us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480850.531255:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1782480850.531491:0:11558:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11558:1869066388170752:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480850.531519:0:11558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480850.531529:0:11558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480850.531532:0:11558:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782480850.531538:0:11558:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d6c29a2000 00000020:00000080:1.0:1782480850.531540:0:11558:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782480850.531620:0:11558:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11558:1869066388170880:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480850.531678:0:11558:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480850.531705:0:11558:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c535ef00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480850.532085:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388170880 00000100:00100000:3.0:1782480850.532091:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388170880 00000100:00100000:3.0:1782480850.532130:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:3.0:1782480850.532138:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:11558:x1869066388170880:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480850.532484:0:11558:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11558:1869066388170880:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480850.532510:0:11558:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480850.532515:0:11558:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480850.532517:0:11558:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782480850.532521:0:11558:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000100:00100000:3.0:1782480850.533016:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:11558:x1869066388170880:12345-0@lo:502:llog_process_th.0 Request processed in 877us (1357us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480850.533024:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000020:01000000:3.0:1782480850.533065:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1782480850.533082:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782480850.533092:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480850.533102:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480850.533111:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1782480850.533114:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c7ca2800 from 7 10000000:01000000:3.0:1782480850.533116:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782480850.533149:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480850.533164:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480850.533173:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480850.533193:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782480850.533232:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480850.533260:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c5018600 going to sleep for 11 seconds 00000100:00100000:1.0:1782480850.533503:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388171008 00000100:00100000:1.0:1782480850.533509:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388171008 00000100:00100000:1.0:1782480850.533547:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782480850.533556:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:5799:x1869066388171008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480850.533567:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480850.533580:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf532d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5326 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480850.533604:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf532d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5326 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480850.533616:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf532d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5326 expref: 18 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480850.533625:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c167ba00, rc 0) 00000100:00100000:1.0:1782480850.533693:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388171008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 138us (460us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480850.533700:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1782480850.533735:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1782480850.533747:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480850.533756:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480850.533803:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480850.533836:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480850.533854:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c535eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480850.533864:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388171136 00000100:00100000:1.0:1782480850.533867:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388171136 00000100:00100000:1.0:1782480850.533899:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1782480850.533904:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388171136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480850.534121:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388171136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 215us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480850.534128:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:1.0:1782480850.534156:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1782480850.534180:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480850.534216:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480850.534229:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c535eb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480850.534240:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388171264 00000100:00100000:1.0:1782480850.534243:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388171264 00000100:00100000:1.0:1782480850.534263:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1782480850.534269:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388171264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1782480850.535006:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388171264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 733us (786us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480850.535013:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:1.0:1782480850.535058:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480850.538023:0:11559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11559:1869066388171392:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480850.538125:0:11559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480850.538166:0:11559:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2ba900 going to sleep for 11 seconds 00000100:00100000:0.0:1782480850.538198:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388171392 00000100:00100000:0.0:1782480850.538205:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388171392 00000100:00100000:0.0:1782480850.538251:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:0.0:1782480850.538262:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:11559:x1869066388171392:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480850.539477:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:11559:x1869066388171392:12345-0@lo:502:llog_process_th.0 Request processed in 1213us (1347us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480850.539489:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:1.0:1782480850.541481:0:11559:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11559:1869066388171392:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480850.541526:0:11559:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480850.541537:0:11559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480850.541540:0:11559:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782480850.541545:0:11559:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d7c7ca2800 00000020:00000080:1.0:1782480850.541548:0:11559:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782480850.541649:0:11559:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11559:1869066388171520:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480850.541737:0:11559:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480850.541770:0:11559:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c535eb40 going to sleep for 11 seconds 00000100:00100000:0.0:1782480850.541901:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388171520 00000100:00100000:0.0:1782480850.541909:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388171520 00000100:00100000:0.0:1782480850.542260:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:0.0:1782480850.542343:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:11559:x1869066388171520:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480850.545467:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:11559:x1869066388171520:12345-0@lo:502:llog_process_th.0 Request processed in 3187us (3718us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480850.545486:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:2.0:1782480850.546738:0:11559:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11559:1869066388171520:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782480850.546802:0:11559:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480850.546813:0:11559:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480850.546815:0:11559:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782480850.546821:0:11559:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1782480850.547394:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1782480850.547423:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782480850.547439:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480850.547465:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480850.547479:0:5799:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782480850.547482:0:5799:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c52cd800 from 7 10000000:01000000:0.0:1782480850.547485:0:5799:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782480850.547525:0:5799:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480850.547533:0:5799:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480850.547543:0:5799:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480850.547566:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171648:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782480850.547631:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480850.547710:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2ba9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480850.547796:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388171648 00000100:00100000:2.0:1782480850.547803:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388171648 00000100:00100000:2.0:1782480850.547852:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 268 00000100:00100000:2.0:1782480850.547862:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:5799:x1869066388171648:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480850.547887:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480850.547901:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2ce00/0x4776e02a9acf533b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf5334 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480850.547924:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2ce00/0x4776e02a9acf533b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf5334 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480850.547935:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2ce00/0x4776e02a9acf533b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf5334 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480850.547945:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2ce00, rc 0) 00000100:00100000:2.0:1782480850.547984:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388171648:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480850.547991:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 268 00000100:00100000:0.0:1782480850.548377:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171648:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480850.548391:0:5799:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480850.548400:0:5799:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480850.548449:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480850.548476:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480850.548518:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ef2ba9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480850.548532:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388171776 00000100:00100000:0.0:1782480850.548536:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388171776 00000100:00100000:0.0:1782480850.548559:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 269 00000100:00100000:0.0:1782480850.548565:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388171776:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782480850.549414:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388171776:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 845us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480850.549424:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 269 00000100:00100000:2.0:1782480850.549589:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171776:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480850.549637:0:5799:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480850.549992:0:5799:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480850.550131:0:5799:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d21a16c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480850.550172:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388171904 00000100:00100000:0.0:1782480850.550178:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388171904 00000100:00100000:0.0:1782480850.550244:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 270 00000100:00100000:0.0:1782480850.550252:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388171904:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480850.550440:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:5799:x1869066388171904:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 188us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480850.550447:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 270 00000100:00100000:3.0:1782480850.550513:0:5799:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:58b05c0b-51b3-47cf-95bc-f3947e9ac894:5799:1869066388171904:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480850.550752:0:11562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11562:1869066388172032:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480850.550807:0:11562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480850.551197:0:11562:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c5018c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480850.551241:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388172032 00000100:00100000:2.0:1782480850.551252:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388172032 00000100:00100000:2.0:1782480850.551332:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1782480850.551339:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c5257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:11562:x1869066388172032:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480850.551492:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c5257050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:11562:x1869066388172032:12345-0@lo:502:llog_process_th.0 Request processed in 153us (683us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480850.551499:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 271 00000100:00100000:2.0:1782480850.551546:0:11562:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11562:1869066388172032:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782480850.551573:0:11562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480850.551582:0:11562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480850.551585:0:11562:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782480850.551591:0:11562:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d7c52cd800 00000020:00000080:2.0:1782480850.551594:0:11562:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1782480850.553047:0:11562:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11562:1869066388172160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480850.554601:0:11562:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480850.554650:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388172160 00000100:00100000:2.0:1782480850.554674:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388172160 00000100:00100000:3.0:1782480850.555551:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 272 00000100:00100000:3.0:1782480850.555567:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:11562:x1869066388172160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1782480850.555964:0:11562:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d21a1180 going to sleep for 11 seconds 00000100:00100000:3.0:1782480850.560848:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:11562:x1869066388172160:12345-0@lo:502:llog_process_th.0 Request processed in 5278us (6242us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480850.560862:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 272 00000100:00100000:1.0:1782480850.560953:0:11562:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:58b05c0b-51b3-47cf-95bc-f3947e9ac894:11562:1869066388172160:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480850.560995:0:11562:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480850.561004:0:11562:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480850.561006:0:11562:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782480850.561011:0:11562:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1782480850.563959:0:5799:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1782480850.563993:0:5799:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782480850.564007:0:5799:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480850.564020:0:5799:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480850.594760:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782480850.847773:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388172288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480850.847847:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480850.848104:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388172288 00000100:00100000:2.0:1782480850.848113:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388172288 00000100:00100000:2.0:1782480850.848184:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782480850.848193:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388172288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1782480850.848230:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1782480850.848789:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480850.848830:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388172416:0@lo:400:kworker.0 00000100:00100000:1.0:1782480850.848868:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480850.848926:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388172416 00000100:00100000:1.0:1782480850.848931:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388172416 00000100:00100000:1.0:1782480850.848980:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782480850.848987:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388172416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480850.849029:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388172416:12345-0@lo:400:kworker.0 Request processed in 41us (158us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480850.849036:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:1.0:1782480850.849078:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388172416:0@lo:400:kworker.0 00000100:00100000:3.0:1782480850.850182:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388172672:0@lo:400:kworker.0 00000100:00100000:3.0:1782480850.850235:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480850.850418:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388172288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 2224us (2569us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480850.850429:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1782480850.850474:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388172672 00000100:00100000:2.0:1782480850.850481:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388172672 00000100:00100000:2.0:1782480850.850536:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782480850.850559:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388172672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480850.850603:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dde680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388172672:12345-0@lo:400:kworker.0 Request processed in 47us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480850.850611:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:2.0:1782480850.850630:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480850.850737:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388172544:0@lo:400:kworker.0 00000100:00100000:1.0:1782480850.850772:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480850.850811:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480850.850820:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388172800:0@lo:400:kworker.0 00000100:00100000:1.0:1782480850.850844:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480850.850937:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388172544 00000100:00100000:2.0:1782480850.850942:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388172544 00000100:00100000:2.0:1782480850.850982:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388172800 00000100:00100000:2.0:1782480850.850985:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388172800 00000100:00100000:2.0:1782480850.851008:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782480850.851013:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388172544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480850.851050:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4aaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388172544:12345-0@lo:400:kworker.0 Request processed in 36us (278us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480850.851057:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1782480850.851069:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782480850.851076:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388172800:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480850.851102:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388172800:12345-0@lo:400:kworker.0 Request processed in 28us (257us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480850.851107:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1782480850.851143:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5a8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388172544:0@lo:400:kworker.0 00000100:00080000:1.0:1782480850.851208:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480850.851226:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388172800:0@lo:400:kworker.0 00000100:00100000:3.0:1782480850.851502:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1782480850.851510:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7df4c8000, transno 4294967300 00000100:00100000:3.0:1782480850.851520:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388172672:0@lo:400:kworker.0 00010000:00080000:0.0:1782480850.856809:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4abb80 x1869066388172288/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480866 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480850.856835:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4abb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388172288:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782480850.919279:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480851.119407:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480851.119523:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366114304 00000100:00100000:2.0:1782480851.119533:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366114304 00000100:00100000:2.0:1782480851.119593:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 273 00000100:00100000:2.0:1782480851.119601:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:5569:x1869066366114304:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480851.119618:0:5797:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480851.119678:0:5797:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2c800/0x4776e02a9acf5342 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc61 expref: -99 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480851.119708:0:5797:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2c800/0x4776e02a9acf5342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc61 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480851.119719:0:5797:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2c800/0x4776e02a9acf5342 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc61 expref: 12 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480851.119820:0:5797:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2c800, rc 0) 00000100:00100000:2.0:1782480851.119890:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366114304:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 288us (492us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480851.120132:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 273 00000100:00100000:1.0:1782480851.126500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480851.126583:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366114432 00000100:00100000:3.0:1782480851.126593:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366114432 00000100:00100000:3.0:1782480851.126686:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 274 00000100:00100000:3.0:1782480851.126697:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366114432:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480851.127023:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366114432:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 326us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480851.127030:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 274 00000100:00100000:3.0:1782480851.131158:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480851.131275:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366114560 00000100:00100000:0.0:1782480851.131287:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366114560 00000100:00100000:0.0:1782480851.131353:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 275 00000100:00100000:0.0:1782480851.131364:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366114560:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782480851.131648:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366114560:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 285us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480851.131699:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 275 00000100:00100000:0.0:1782480851.135420:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480851.140744:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366114688 00000100:00100000:2.0:1782480851.140762:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366114688 00000100:00100000:2.0:1782480851.140838:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 276 00000100:00100000:2.0:1782480851.140847:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:9927:x1869066366114688:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782480851.141150:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:9927:x1869066366114688:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 303us (5740us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480851.141159:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 276 00000100:00100000:1.0:1782480851.145284:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480851.145411:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366114816 00000100:00100000:3.0:1782480851.145421:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366114816 00000100:00100000:3.0:1782480851.145476:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 277 00000100:00100000:3.0:1782480851.145486:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:9927:x1869066366114816:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782480851.146359:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:9927:x1869066366114816:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 866us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480851.146371:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 277 00000100:00100000:3.0:1782480851.152971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480851.162926:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366114944 00000100:00100000:0.0:1782480851.162942:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366114944 00000100:00100000:0.0:1782480851.163018:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 278 00000100:00100000:0.0:1782480851.163029:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:5569:x1869066366114944:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480851.163047:0:5794:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480851.164992:0:5794:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf5349 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc68 expref: -99 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480851.165034:0:5794:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf5349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc68 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480851.165047:0:5794:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf5349 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc68 expref: 13 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480851.165058:0:5794:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a400, rc 0) 00000100:00100000:0.0:1782480851.165143:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:5569:x1869066366114944:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 2115us (12180us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480851.165152:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 278 00000100:00100000:0.0:1782480851.172970:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480851.173069:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366115072 00000100:00100000:3.0:1782480851.173078:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366115072 00000100:00100000:3.0:1782480851.173133:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 279 00000100:00100000:3.0:1782480851.173160:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:5569:x1869066366115072:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480851.173484:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:5569:x1869066366115072:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 324us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480851.173494:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 279 00000100:00100000:1.0:1782480851.175242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480851.175326:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366115200 00000100:00100000:2.0:1782480851.175336:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366115200 00000100:00100000:2.0:1782480851.175386:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 280 00000100:00100000:2.0:1782480851.175396:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:5569:x1869066366115200:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480851.175639:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:5569:x1869066366115200:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 243us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480851.175648:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 280 00000100:00100000:1.0:1782480851.182134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480851.182254:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366115328 00000100:00100000:0.0:1782480851.182275:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366115328 00000100:00100000:0.0:1782480851.182339:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 281 00000100:00100000:0.0:1782480851.182350:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:9930:x1869066366115328:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782480851.182631:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:9930:x1869066366115328:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 282us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480851.182646:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 281 00000100:00100000:0.0:1782480851.191255:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480851.191368:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366115456 00000100:00100000:3.0:1782480851.191381:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366115456 00000100:00100000:3.0:1782480851.191443:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 282 00000100:00100000:3.0:1782480851.191453:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:9930:x1869066366115456:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782480851.191787:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:9930:x1869066366115456:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 333us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480851.191796:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 282 00000040:00080000:1.0:1782480851.615736:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782480851.935003:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480852.959056:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480853.407454:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480853.407481:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388172928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480853.407572:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480853.408184:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388172928 00000100:00100000:1.0:1782480853.408196:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388172928 00000100:00100000:1.0:1782480853.408271:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1782480853.408282:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388172928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480853.408317:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480853.408379:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388172928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 100us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480853.408386:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782480853.408498:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4aa300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388172928:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782480853.408568:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480853.492218:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480853.492276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480853.492993:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480853.493619:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366115712 00000100:00100000:0.0:1782480853.493631:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366115712 00000100:00100000:0.0:1782480853.493726:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366115968 00000100:00100000:0.0:1782480853.493730:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366115968 00000100:00100000:0.0:1782480853.493766:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:0.0:1782480853.493776:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366115712:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480853.493871:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366115712:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 96us (1594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480853.493880:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:0.0:1782480853.493898:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:0.0:1782480853.493905:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366115968:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480853.493933:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366115968:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (942us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480853.493939:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:2.0:1782480853.494641:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366115584 00000100:00100000:2.0:1782480853.494649:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366115584 00000100:00100000:2.0:1782480853.494721:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 283 00000100:00100000:2.0:1782480853.494729:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366115584:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480853.494778:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366115584:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 50us (2570us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480853.494786:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 283 00000100:00080000:1.0:1782480853.495443:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480853.505048:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480853.513447:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366115840 00000100:00100000:3.0:1782480853.513460:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366115840 00000100:00100000:3.0:1782480853.513546:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00080000:1.0:1782480853.513551:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480853.513557:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2352:x1869066366115840:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480853.513639:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2352:x1869066366115840:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 83us (8990us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480853.513648:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00010000:00010000:2.0:1782480853.985651:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480855.007075:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480855.966992:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388173312:0@lo:400:kworker.0 00000100:00100000:3.0:1782480855.967074:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480855.967226:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388173056:0@lo:400:kworker.0 00000100:00100000:2.0:1782480855.967262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480855.967294:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388173440:0@lo:400:kworker.0 00000100:00100000:2.0:1782480855.967322:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480855.967355:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388173440 00000100:00100000:2.0:1782480855.967362:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388173440 00000100:00100000:2.0:1782480855.967419:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782480855.967429:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388173440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480855.967485:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388173440:12345-0@lo:400:kworker.0 Request processed in 57us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480855.967492:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782480855.967572:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388173184:0@lo:400:kworker.0 00000100:00100000:0.0:1782480855.967602:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480855.967636:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388173312 00000100:00100000:0.0:1782480855.967640:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388173312 00000100:00100000:0.0:1782480855.967687:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388173184 00000100:00100000:0.0:1782480855.967690:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388173184 00000100:00100000:0.0:1782480855.967709:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782480855.967721:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388173312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480855.967750:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc53480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388173312:12345-0@lo:400:kworker.0 Request processed in 30us (677us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480855.967756:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782480855.967767:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782480855.967772:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388173184:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480855.967808:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388173184:12345-0@lo:400:kworker.0 Request processed in 35us (205us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480855.967813:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:0.0:1782480855.967835:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388173056 00000100:00100000:0.0:1782480855.967837:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388173056 00000100:00100000:0.0:1782480855.967856:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 284 00000100:00100000:0.0:1782480855.967861:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388173056:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480855.967889:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388173056:12345-0@lo:400:kworker.0 Request processed in 28us (626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480855.967894:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 284 00000100:00100000:3.0:1782480855.968296:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388173312:0@lo:400:kworker.0 00000100:00100000:0.0:1782480855.968379:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388173056:0@lo:400:kworker.0 00000100:00100000:0.0:1782480855.968387:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388173568:0@lo:400:kworker.0 00000100:00100000:0.0:1782480855.968412:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480855.968503:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc50e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388173440:0@lo:400:kworker.0 00000100:00100000:3.0:1782480855.968553:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388173568 00000100:00100000:3.0:1782480855.968557:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388173568 00000100:00100000:0.0:1782480855.968637:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4dde300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388173184:0@lo:400:kworker.0 00000100:00100000:0.0:1782480855.968644:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388173696:0@lo:400:kworker.0 00000100:00100000:0.0:1782480855.968684:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480855.968717:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388173696 00000100:00100000:0.0:1782480855.968720:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388173696 00000100:00100000:0.0:1782480855.968749:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782480855.968765:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388173696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480855.968812:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388173696:12345-0@lo:400:kworker.0 Request processed in 48us (127us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480855.968818:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00010000:00080000:0.0:1782480855.968845:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7efc52d80 x1869066388173696/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480871 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480855.968857:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc52d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388173696:0@lo:400:kworker.0 00000100:00100000:3.0:1782480855.968924:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1782480855.968931:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388173568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480855.968968:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388173568:12345-0@lo:400:kworker.0 Request processed in 39us (555us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480855.968974:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1782480855.969021:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc51500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388173568:0@lo:400:kworker.0 00000100:00080000:1.0:1782480855.970441:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480855.970449:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782480855.970451:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480855.970458:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480855.970472:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388173824:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480855.970530:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480855.970573:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388173824 00000100:00100000:1.0:1782480855.970579:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388173824 00000100:00100000:1.0:1782480855.970617:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1782480855.970623:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388173824:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480855.970656:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480855.970725:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388173824:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (194us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480855.970732:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:1.0:1782480855.970763:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4a9c00 x1869066388173824/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480871 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480855.970791:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388173824:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782480856.030892:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480857.057857:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480858.079093:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480858.527077:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480858.527100:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388173952:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480858.527169:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480858.527601:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388173952 00000100:00100000:1.0:1782480858.527609:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388173952 00000100:00100000:1.0:1782480858.527695:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1782480858.527705:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388173952:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480858.527750:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480858.527826:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388173952:12345-0@lo:13:osp-pre-0-0.0 Request processed in 121us (656us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480858.527833:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782480858.527984:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388173952:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782480858.528056:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480858.605098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480858.605148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480858.605190:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480858.605239:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366116096 00000100:00100000:0.0:1782480858.605250:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366116096 00000100:00100000:2.0:1782480858.605252:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480858.605278:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366116224 00000100:00100000:2.0:1782480858.605282:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366116224 00000100:00100000:0.0:1782480858.605306:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 285 00000100:00100000:0.0:1782480858.605317:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366116096:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480858.605337:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366116480 00000100:00100000:2.0:1782480858.605339:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366116480 00000100:00100000:2.0:1782480858.605362:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:2.0:1782480858.605368:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366116224:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480858.605399:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366116224:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 30us (206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480858.605399:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366116096:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 83us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480858.605406:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:0.0:1782480858.605407:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 285 00000100:00100000:2.0:1782480858.605422:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00100000:2.0:1782480858.605427:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366116480:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480858.605458:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366116480:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 31us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480858.605464:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00080000:2.0:1782480858.605479:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480858.606115:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366116352 00000100:00100000:3.0:1782480858.606123:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366116352 00000100:00080000:2.0:1782480858.606170:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480858.606178:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:3.0:1782480858.606187:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366116352:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480858.606227:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366116352:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 42us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480858.606234:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00010000:00010000:0.0:1782480859.103593:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480860.126909:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480861.087093:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388174464:0@lo:400:kworker.0 00000100:00100000:1.0:1782480861.087171:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480861.087193:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388174208:0@lo:400:kworker.0 00000100:00100000:2.0:1782480861.087239:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480861.087246:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782480861.087256:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388174336:0@lo:400:kworker.0 00000100:00100000:2.0:1782480861.087277:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388174720:0@lo:400:kworker.0 00000100:00100000:1.0:1782480861.087287:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480861.087311:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480861.087315:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388174848:0@lo:400:kworker.0 00000100:00100000:2.0:1782480861.087341:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782480861.087349:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388174080:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480861.087378:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480861.087384:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480861.087399:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388174592:0@lo:400:kworker.0 00000100:00100000:1.0:1782480861.087425:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388174464 00000100:00100000:1.0:1782480861.087435:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388174464 00000100:00100000:2.0:1782480861.087437:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480861.087475:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388174336 00000100:00100000:2.0:1782480861.087480:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388174336 00000100:00100000:1.0:1782480861.087503:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388174720 00000100:00100000:1.0:1782480861.087508:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388174720 00000100:00100000:2.0:1782480861.087512:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782480861.087524:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388174464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480861.087537:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1782480861.087545:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388174336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480861.087610:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388174464:12345-0@lo:400:kworker.0 Request processed in 88us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480861.087617:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1782480861.087636:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:2.0:1782480861.087643:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388174720:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480861.087717:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388174848 00000100:00100000:3.0:1782480861.087722:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388174848 00000100:00100000:3.0:1782480861.087751:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388174592 00000100:00100000:3.0:1782480861.087754:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388174592 00000100:00100000:3.0:1782480861.087772:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782480861.087779:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388174848:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480861.087816:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388174848:12345-0@lo:400:kworker.0 Request processed in 37us (432us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480861.087841:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1782480861.087854:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782480861.087860:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388174592:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480861.087895:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388174592:12345-0@lo:400:kworker.0 Request processed in 35us (459us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480861.087902:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782480861.087922:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388174080 00000100:00100000:3.0:1782480861.087926:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388174080 00000100:00100000:2.0:1782480861.087945:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388174720:12345-0@lo:400:kworker.0 Request processed in 301us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480861.087955:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:3.0:1782480861.087970:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1782480861.087980:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388174080:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480861.087999:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388174592:0@lo:400:kworker.0 00002000:00000024:3.0:1782480861.088009:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480861.088013:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388174720:0@lo:400:kworker.0 00000100:00080000:2.0:1782480861.088084:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480861.088088:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480861.088092:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480861.088120:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388174208 00000100:00100000:0.0:1782480861.088125:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388174208 00000100:00100000:3.0:1782480861.088178:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388174080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 201us (799us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480861.088186:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:3.0:1782480861.088214:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4aad80 x1869066388174080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480877 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480861.088228:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388174080:0@lo:13:osp-pre-1-0.0 00010000:00080000:3.0:1782480861.088277:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7df4a9c00 x1869066388174848/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480877 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480861.088286:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388174848:0@lo:400:kworker.0 00000100:00100000:3.0:1782480861.088295:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ab100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388174464:0@lo:400:kworker.0 00000100:00100000:1.0:1782480861.089752:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4abb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388174336:12345-0@lo:400:kworker.0 Request processed in 2199us (2456us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480861.089765:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1782480861.091593:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388174336:0@lo:400:kworker.0 00000100:00100000:2.0:1782480861.096072:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 286 00000100:00100000:2.0:1782480861.096099:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388174208:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480861.096274:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388174208:12345-0@lo:400:kworker.0 Request processed in 188us (9034us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480861.096281:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 286 00000100:00100000:3.0:1782480861.105247:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388174208:0@lo:400:kworker.0 00010000:00010000:0.0:1782480861.151963:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782480861.861355:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782480862.176930:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480863.199254:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480863.648479:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480863.648504:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388174976:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480863.648579:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480863.648682:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388174976 00000100:00100000:1.0:1782480863.648692:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388174976 00000100:00100000:1.0:1782480863.648754:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782480863.648768:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388174976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480863.648825:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480863.648873:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388174976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480863.648880:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:1.0:1782480863.648903:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480863.648939:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006ad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388174976:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480863.723995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480863.724054:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480863.724176:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366116608 00000100:00100000:0.0:1782480863.724187:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366116608 00000100:00100000:0.0:1782480863.724248:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 287 00000100:00100000:0.0:1782480863.724259:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2351:x1869066366116608:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480863.724343:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c771ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2351:x1869066366116608:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 87us (359us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480863.724351:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 287 00000100:00100000:3.0:1782480863.724566:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366116736 00000100:00100000:3.0:1782480863.724571:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366116736 00000100:00100000:3.0:1782480863.724628:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:3.0:1782480863.724635:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2351:x1869066366116736:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480863.724706:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2351:x1869066366116736:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 72us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480863.724770:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00080000:1.0:1782480863.724830:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480863.745375:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480863.746221:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366116864 00000100:00100000:3.0:1782480863.746244:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366116864 00000100:00100000:3.0:1782480863.746322:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:3.0:1782480863.746332:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2349:x1869066366116864:12345-192.168.201.58@tcp:9:kworker.0 00000020:00000080:3.0:1782480863.746363:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf5285 00000100:00080000:3.0:1782480863.746369:0:6608:0:(import.c:65:import_set_state_nolock()) ffff91d7c4a8e000 : changing import state from FULL to CLOSED 00000100:00080000:1.0:1782480863.746503:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00000004:3.0:1782480863.746563:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1782480863.746886:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+2:2349:x1869066366116864:12345-192.168.201.58@tcp:9:kworker.0 Request processed in 554us (1521us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480863.746895:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00010000:00010000:0.0:1782480863.749965:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480863.752009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480863.752585:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366116992 00000100:00100000:2.0:1782480863.752598:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366116992 00000100:00100000:2.0:1782480863.752716:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:2.0:1782480863.752729:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366116992:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:0.0:1782480863.752838:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480863.753769:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366116992:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 1033us (1760us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480863.753781:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 135 00010000:00010000:0.0:1782480864.223780:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480865.247249:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480866.208578:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388175104:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480866.208691:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480866.210012:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388175104 00000100:00100000:1.0:1782480866.210024:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388175104 00000100:00100000:1.0:1782480866.210118:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1782480866.210130:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388175104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480866.210169:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480866.210244:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388175104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 117us (1553us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480866.210253:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00010000:00080000:2.0:1782480866.210281:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d8006af480 x1869066388175104/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480882 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782480866.210301:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006af480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388175104:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782480866.211910:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480866.214063:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388175488:0@lo:400:kworker.0 00000100:00100000:2.0:1782480866.214091:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388175232:0@lo:400:kworker.0 00000100:00100000:3.0:1782480866.214147:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480866.214148:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480866.214191:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1782480866.214200:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388175360:0@lo:400:kworker.0 00000100:00100000:2.0:1782480866.214206:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388175744:0@lo:400:kworker.0 00000100:00100000:3.0:1782480866.214231:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480866.214252:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388175232 00000100:00100000:2.0:1782480866.214261:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388175232 00000100:00100000:3.0:1782480866.214287:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388175488 00000100:00100000:3.0:1782480866.214292:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388175488 00000100:00100000:3.0:1782480866.214349:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388175360 00000100:00100000:3.0:1782480866.214353:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388175360 00000100:00100000:2.0:1782480866.214354:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 288 00000100:00100000:2.0:1782480866.214363:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388175232:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480866.214399:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782480866.214409:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388175488:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480866.214418:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388175232:12345-0@lo:400:kworker.0 Request processed in 54us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480866.214425:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 288 00000100:00100000:3.0:1782480866.214456:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc53800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388175488:12345-0@lo:400:kworker.0 Request processed in 48us (311us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480866.214463:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1782480866.214478:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1782480866.214485:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388175360:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1782480866.214488:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480866.214502:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480866.214589:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388175744 00000100:00100000:1.0:1782480866.214594:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388175744 00000100:00100000:1.0:1782480866.214636:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1782480866.214642:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388175744:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480866.214743:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388175616:0@lo:400:kworker.0 00000100:00100000:2.0:1782480866.214763:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc51c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388175232:0@lo:400:kworker.0 00000100:00100000:0.0:1782480866.214790:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480866.214816:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388175360:0@lo:400:kworker.0 00000100:00100000:0.0:1782480866.214821:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388175616 00000100:00100000:0.0:1782480866.214824:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388175616 00000100:00100000:2.0:1782480866.214826:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388175488:0@lo:400:kworker.0 00000100:00100000:0.0:1782480866.214853:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782480866.214859:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388175616:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480866.214894:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388175616:12345-0@lo:400:kworker.0 Request processed in 35us (117us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480866.214900:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1782480866.214927:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc52300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388175616:0@lo:400:kworker.0 00000100:00080000:0.0:1782480866.214965:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480866.214968:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480866.225088:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc52a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388175360:12345-0@lo:400:kworker.0 Request processed in 10590us (10844us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480866.225104:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1782480866.229117:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4ab100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388175744:12345-0@lo:400:kworker.0 Request processed in 14462us (14602us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480866.229134:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1782480866.229223:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc52680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388175744:0@lo:400:kworker.0 00010000:00010000:0.0:1782480866.270920:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480867.294879:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480868.325641:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480868.773420:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480868.773456:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388175872:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480868.773530:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480868.773626:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388175872 00000100:00100000:2.0:1782480868.773634:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388175872 00000100:00100000:2.0:1782480868.773708:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782480868.773719:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388175872:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480868.773754:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480868.773794:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4aad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388175872:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480868.773802:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1782480868.773848:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388175872:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782480868.774128:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00100000:0.0:1782480868.793193:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:0.0:1782480868.793203:0:6632:0:(genops.c:906:class_export_put()) final put ffff91d7c4a8f800/227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:1.0:1782480868.793371:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c4a8f800/227f6c69-cfd7-4cc4-bae6-15b91431c78c for lustre-OST0000 00000020:00000080:1.0:1782480868.793533:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7c4a8e000 for lustre-OST0000 00000100:00100000:2.0:1782480868.845734:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480868.845786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480868.845862:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480868.847174:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366117248 00000100:00100000:0.0:1782480868.847200:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366117248 00000100:00100000:0.0:1782480868.847265:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366117376 00000100:00100000:0.0:1782480868.847268:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366117376 00000100:00100000:0.0:1782480868.847292:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 139 00000100:00100000:0.0:1782480868.847301:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366117248:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480868.847370:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366117248:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 71us (1646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480868.847378:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 139 00000100:00100000:0.0:1782480868.847392:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 140 00000100:00100000:0.0:1782480868.847397:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366117376:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480868.847417:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366117376:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 20us (1556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480868.847422:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 140 00000100:00080000:2.0:1782480868.848691:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480868.849855:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366117120 00000100:00100000:3.0:1782480868.849870:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366117120 00000100:00100000:3.0:1782480868.849981:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 289 00000100:00100000:3.0:1782480868.849990:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366117120:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480868.850067:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366117120:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 79us (4290us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480868.850075:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 289 00010000:00010000:0.0:1782480869.344518:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480870.371610:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782480871.076811:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1782480871.330093:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388176384:0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330169:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480871.330233:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782480871.330240:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388176000:0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330270:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480871.330294:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388176512:0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330319:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480871.330344:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388176128:0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330366:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480871.330380:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388176640:0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330400:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480871.330428:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480871.330433:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388176256:0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330455:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480871.330487:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388176384 00000100:00100000:0.0:1782480871.330496:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388176384 00000100:00100000:0.0:1782480871.330558:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388176640 00000100:00100000:0.0:1782480871.330561:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388176640 00000100:00100000:0.0:1782480871.330586:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782480871.330596:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388176384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330648:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388176384:12345-0@lo:400:kworker.0 Request processed in 53us (478us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480871.330655:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782480871.330695:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782480871.330701:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388176640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330736:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388176640:12345-0@lo:400:kworker.0 Request processed in 35us (335us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480871.330742:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782480871.330774:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388176000 00000100:00100000:0.0:1782480871.330778:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388176000 00000100:00100000:0.0:1782480871.330803:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782480871.330809:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388176000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330837:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388176000:12345-0@lo:400:kworker.0 Request processed in 28us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480871.330843:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 290 00000100:00100000:0.0:1782480871.330868:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388176512 00000100:00100000:0.0:1782480871.330871:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388176512 00000100:00100000:0.0:1782480871.330892:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388176128 00000100:00100000:0.0:1782480871.330894:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388176128 00000100:00100000:0.0:1782480871.330911:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388176256 00000100:00100000:0.0:1782480871.330913:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388176256 00000100:00100000:0.0:1782480871.330926:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782480871.330931:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388176512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330957:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388176512:12345-0@lo:400:kworker.0 Request processed in 27us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480871.330963:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:0.0:1782480871.330973:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782480871.330978:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388176128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.330998:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388176128:12345-0@lo:400:kworker.0 Request processed in 20us (631us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480871.331003:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1782480871.331011:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1782480871.331017:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388176256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.331036:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388176256:12345-0@lo:400:kworker.0 Request processed in 20us (581us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480871.331041:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00080000:0.0:1782480871.331066:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480871.331070:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480871.331072:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480871.331114:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388176256:0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.331127:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ca300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388176128:0@lo:400:kworker.0 00010000:00080000:0.0:1782480871.331139:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ef3b8e00 x1869066388176640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1782480887 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480871.331148:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388176640:0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.331197:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388176000:0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.331208:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388176512:0@lo:400:kworker.0 00000100:00100000:0.0:1782480871.331219:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388176384:0@lo:400:kworker.0 00000100:00100000:2.0:1782480871.335623:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480871.335651:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388176768:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480871.335745:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480871.335921:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388176768 00000100:00100000:1.0:1782480871.335932:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388176768 00000100:00100000:1.0:1782480871.335999:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782480871.336009:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388176768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480871.336049:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480871.336102:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388176768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (356us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480871.336110:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:1.0:1782480871.336151:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d8006af100 x1869066388176768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480887 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480871.336171:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388176768:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1782480871.400154:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480872.414919:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480873.438937:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480873.890953:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388176896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480873.891056:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480873.891509:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388176896 00000100:00100000:1.0:1782480873.891518:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388176896 00000100:00100000:1.0:1782480873.891585:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782480873.891594:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388176896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480873.891629:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480873.891700:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece69c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388176896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (643us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480873.891707:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00080000:0.0:1782480873.891763:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480873.891836:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006af100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388176896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480873.980553:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480873.980634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480873.980714:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480873.980741:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366117760 00000100:00100000:2.0:1782480873.980749:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366117760 00000100:00100000:2.0:1782480873.980801:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366117632 00000100:00100000:2.0:1782480873.980804:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366117632 00000100:00100000:2.0:1782480873.980827:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 144 00000100:00100000:2.0:1782480873.980849:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2351:x1869066366117760:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480873.980920:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2351:x1869066366117760:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 85us (285us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480873.980927:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 144 00000100:00100000:2.0:1782480873.980945:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 145 00000100:00100000:2.0:1782480873.980951:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2351:x1869066366117632:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480873.980976:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2351:x1869066366117632:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480873.980982:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 145 00000100:00080000:2.0:1782480873.980997:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480873.985898:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366117504 00000100:00100000:0.0:1782480873.985914:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366117504 00000100:00100000:0.0:1782480873.985969:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 291 00000100:00100000:0.0:1782480873.985979:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2351:x1869066366117504:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480873.986057:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2351:x1869066366117504:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 80us (5515us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480873.986066:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 291 00000001:02000400:3.0:1782480874.051000:0:11728:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 09:34:32 (1782480872) 00010000:00010000:2.0:1782480874.462897:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480875.499863:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480876.447446:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480876.449809:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388177152:0@lo:400:kworker.0 00000100:00100000:1.0:1782480876.449904:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480876.449964:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480876.449970:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388177280:0@lo:400:kworker.0 00000100:00100000:1.0:1782480876.450017:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480876.450060:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388177280 00000100:00100000:1.0:1782480876.450070:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388177280 00000100:00100000:1.0:1782480876.450122:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782480876.450131:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388177280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480876.450190:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388177280:12345-0@lo:400:kworker.0 Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480876.450197:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1782480876.450239:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388177280:0@lo:400:kworker.0 00000100:00100000:1.0:1782480876.450942:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388177152 00000100:00100000:1.0:1782480876.450949:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388177152 00000100:00100000:1.0:1782480876.450987:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1782480876.450994:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388177152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480876.451042:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388177152:12345-0@lo:400:kworker.0 Request processed in 48us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480876.451049:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 292 00000100:00100000:1.0:1782480876.451086:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388177152:0@lo:400:kworker.0 00000100:00100000:3.0:1782480876.451815:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388177408:0@lo:400:kworker.0 00000100:00100000:3.0:1782480876.451862:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480876.451886:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388177024:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480876.451910:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480876.457535:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388177408 00000100:00100000:1.0:1782480876.457558:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388177408 00000100:00100000:1.0:1782480876.457681:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782480876.457695:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388177408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480876.457807:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc50a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388177408:12345-0@lo:400:kworker.0 Request processed in 116us (5943us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480876.457814:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1782480876.457840:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388177024 00000100:00100000:1.0:1782480876.457844:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388177024 00000100:00100000:1.0:1782480876.457892:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782480876.457898:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388177024:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480876.457929:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480876.457966:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc53b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388177024:12345-0@lo:13:osp-pre-1-0.0 Request processed in 68us (6055us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480876.457972:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782480876.458020:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388177408:0@lo:400:kworker.0 00010000:00080000:1.0:1782480876.458037:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d8006adc00 x1869066388177024/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782480892 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480876.458055:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388177024:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1782480876.458305:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480876.458311:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480876.463751:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480876.463777:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388177664:0@lo:400:kworker.0 00000100:00100000:0.0:1782480876.463868:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480876.463922:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388177664 00000100:00100000:0.0:1782480876.463931:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388177664 00000100:00100000:0.0:1782480876.463999:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1782480876.464009:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388177664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480876.464065:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388177664:12345-0@lo:400:kworker.0 Request processed in 58us (198us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480876.464074:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1782480876.464098:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480876.464150:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388177664:0@lo:400:kworker.0 00000100:00100000:3.0:1782480876.464283:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480876.464297:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388177536:0@lo:400:kworker.0 00000100:00100000:3.0:1782480876.464343:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480876.464758:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388177536 00000100:00100000:0.0:1782480876.464763:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388177536 00000100:00100000:0.0:1782480876.464844:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782480876.464853:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388177536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480876.464898:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc51f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388177536:12345-0@lo:400:kworker.0 Request processed in 47us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480876.464905:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782480876.464930:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3baa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388177536:0@lo:400:kworker.0 00000100:00080000:2.0:1782480876.471134:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782480876.510903:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480876.674592:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480876.674690:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366117888 00000100:00100000:1.0:1782480876.674703:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366117888 00000100:00100000:1.0:1782480876.674784:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:1.0:1782480876.674794:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:10198:x1869066366117888:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480876.674825:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480876.675047:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5350 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc6f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.675183:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167a200/0x4776e02a9acf5357 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.675199:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167a200/0x4776e02a9acf5357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.675213:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167a200/0x4776e02a9acf5357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480876.675529:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782480876.675534:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480876.675633:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167a200/0x4776e02a9acf5357 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.675703:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5350 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc6f expref: 7 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.675721:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167a200/0x4776e02a9acf5357 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc6f expref: 6 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.675730:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19700) 00010000:00010000:1.0:1782480876.675733:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782480876.675737:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c167a200, rc 0) 00000100:00080000:2.0:1782480876.675974:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480876.676954:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3baa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:10198:x1869066366117888:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 2155us (2369us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480876.676965:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:2.0:1782480876.708445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480876.709918:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366118016 00000100:00100000:0.0:1782480876.709933:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366118016 00000100:00100000:0.0:1782480876.710020:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:0.0:1782480876.710032:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:10199:x1869066366118016:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480876.710062:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480876.710094:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf535e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc76 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.710183:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5365 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.710202:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.710215:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.710233:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf536c lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.710911:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf536c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.710920:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf536c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.711980:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf5373 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.711996:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf5373 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712005:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf5373 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480876.712089:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:0.0:1782480876.712094:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480876.712177:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf5373 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712191:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5365 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712197:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5365 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712204:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712210:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480876.712214:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5365 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712230:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5365 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712243:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19700) 00010000:00010000:0.0:1782480876.712246:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480876.712251:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5365 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712258:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5365 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712617:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf536c lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712623:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf536c lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712630:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf536c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712634:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480876.712637:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf536c lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712643:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf536c lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712651:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91d7c32f3000) 00010000:00010000:0.0:1782480876.712653:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480876.712656:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf536c lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712719:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf536c lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712757:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf535e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc76 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712771:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf5373 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc76 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480876.712779:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d7c32f3a00) 00010000:00010000:0.0:1782480876.712781:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480876.712783:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b400, rc 0) 00000100:00100000:0.0:1782480876.712862:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:10199:x1869066366118016:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 2832us (4428us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480876.712871:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:3.0:1782480876.724935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480876.725147:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366118272 00000100:00100000:1.0:1782480876.725158:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366118272 00000100:00100000:1.0:1782480876.725230:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:1.0:1782480876.725238:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:10199:x1869066366118272:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480876.725258:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480876.725374:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167bc00/0x4776e02a9acf537a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc7d expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.725453:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5381 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.725494:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.725506:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.725865:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167b600/0x4776e02a9acf5388 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.725874:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167b600/0x4776e02a9acf5388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.725882:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167b600/0x4776e02a9acf5388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.734857:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e400/0x4776e02a9acf538f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.734881:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e400/0x4776e02a9acf538f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.734892:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e400/0x4776e02a9acf538f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480876.734905:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:1.0:1782480876.735092:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5381 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735101:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5381 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735108:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5381 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735119:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167aa00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480876.735124:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5381 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735132:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5381 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735145:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d7c32f3a00) 00010000:00010000:1.0:1782480876.735148:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480876.735153:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5381 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735159:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167aa00/0x4776e02a9acf5381 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735186:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167b600/0x4776e02a9acf5388 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735193:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167b600/0x4776e02a9acf5388 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735199:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167b600/0x4776e02a9acf5388 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735204:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480876.735207:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167b600/0x4776e02a9acf5388 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735213:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167b600/0x4776e02a9acf5388 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735229:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91d7c8d19800) 00010000:00010000:1.0:1782480876.735231:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480876.735234:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167b600/0x4776e02a9acf5388 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735241:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167b600/0x4776e02a9acf5388 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735638:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167bc00/0x4776e02a9acf537a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc7d expref: 10 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735655:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e400/0x4776e02a9acf538f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc7d expref: 9 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480876.735717:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:1.0:1782480876.735720:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480876.735722:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55e400, rc 0) 00000100:00100000:1.0:1782480876.735788:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc51180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:10199:x1869066366118272:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 10550us (10860us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782480876.735798:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:1.0:1782480876.743563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480876.743710:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366118400 00000100:00100000:0.0:1782480876.743722:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366118400 00000100:00100000:0.0:1782480876.743775:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1782480876.743784:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:10199:x1869066366118400:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 00000100:00100000:0.0:1782480876.743902:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:10199:x1869066366118400:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 Request processed in 117us (352us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480876.743909:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000040:00080000:1.0:1782480877.215956:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782480877.541591:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782480878.557997:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967309 is committed 00010000:00010000:0.0:1782480878.566952:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480879.015195:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388177792:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480879.015292:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480879.015366:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388177792 00000100:00100000:1.0:1782480879.015389:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388177792 00000100:00100000:1.0:1782480879.015445:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782480879.015461:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388177792:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480879.015515:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480879.015567:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388177792:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (274us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480879.015576:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:1.0:1782480879.015611:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480879.015651:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388177792:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480879.085169:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480879.085214:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480879.085270:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480879.085345:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366118528 00000100:00100000:2.0:1782480879.085433:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366118528 00000100:00100000:2.0:1782480879.085494:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 293 00000100:00100000:2.0:1782480879.085504:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366118528:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480879.085596:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ebc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366118528:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 93us (379us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480879.085603:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 293 00000100:00100000:3.0:1782480879.086094:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366118656 00000100:00100000:3.0:1782480879.086099:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366118656 00000100:00080000:2.0:1782480879.086192:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480879.086226:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366118784 00000100:00100000:3.0:1782480879.086230:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366118784 00000100:00100000:3.0:1782480879.086273:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 149 00000100:00100000:3.0:1782480879.086281:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2352:x1869066366118656:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480879.086327:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2352:x1869066366118656:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 48us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480879.086335:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 149 00000100:00100000:3.0:1782480879.086349:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 150 00000100:00100000:3.0:1782480879.086357:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366118784:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480879.086395:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366118784:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 39us (1124us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480879.086401:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 150 00000100:00080000:2.0:1782480879.086512:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480879.458065:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480879.458140:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366118912 00000100:00100000:3.0:1782480879.458151:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366118912 00000100:00100000:3.0:1782480879.458215:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:3.0:1782480879.458225:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:10242:x1869066366118912:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480879.458247:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480879.458270:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf539d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc84 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458348:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf53a4 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458394:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf53a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458408:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf53a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458426:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf53ab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458433:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf53ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458440:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf53ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458790:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf53a4 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458799:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf53a4 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458806:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf53a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458812:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779bc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480879.458817:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf53a4 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458824:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf53a4 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458837:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19700) 00010000:00010000:3.0:1782480879.458846:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480879.458851:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf53a4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458858:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf53a4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458873:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf53ab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458879:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf53ab lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458884:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf53ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458888:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480879.458891:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf53ab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458896:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf53ab lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458903:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91d7c51d1e00) 00010000:00010000:3.0:1782480879.458905:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480879.458908:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf53ab lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458912:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf53ab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458949:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf539d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc84 expref: 9 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458970:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19700) 00010000:00010000:3.0:1782480879.458973:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480879.458977:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf539d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc84 expref: 9 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480879.458987:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b800, rc 0) 00000100:00100000:3.0:1782480879.459058:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:10242:x1869066366118912:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 834us (1002us total) trans 0 rc 301/301 00000100:00100000:3.0:1782480879.459066:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:3.0:1782480879.468144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480879.468226:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366119168 00000100:00100000:1.0:1782480879.468240:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366119168 00000100:00100000:1.0:1782480879.468302:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:1.0:1782480879.468312:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:10242:x1869066366119168:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:1.0:1782480879.468385:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480879.468419:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c167a200/0x4776e02a9acf5357 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc6f expref: 8 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.468441:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19700) 00010000:00010000:1.0:1782480879.468452:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480879.468769:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53b2 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.468784:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.468796:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.468808:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.468824:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.468830:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480879.469848:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1782480879.469863:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53b2 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.469872:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53b2 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.469880:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.469886:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ea00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480879.469891:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53b2 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.469899:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53b2 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.469910:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:1.0:1782480879.469914:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480879.469918:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53b2 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.469924:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53b2 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782480879.469954:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cd416668 reply state 00000000fccb86c9 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480879.469963:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782480879.470072:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc50700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:10242:x1869066366119168:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 1759us (1935us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782480879.470080:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00010000:00010000:2.0:1782480879.473516:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.473535:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.473542:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.473549:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55fc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480879.473554:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.473561:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.473578:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91d7c8d19a00) 00010000:00010000:2.0:1782480879.473581:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480879.473585:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.473591:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf53b9 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.583031:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480879.612044:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480879.612599:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366119296 00000100:00100000:1.0:1782480879.612611:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366119296 00000100:00100000:1.0:1782480879.612712:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:1.0:1782480879.612723:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:10250:x1869066366119296:12345-192.168.201.58@tcp:101:lctl.0 00010000:00010000:1.0:1782480879.612750:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480879.612773:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53c0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc8b expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.612840:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f400/0x4776e02a9acf53c7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.612855:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f400/0x4776e02a9acf53c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.612866:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f400/0x4776e02a9acf53c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480879.612931:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782480879.612936:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480879.612979:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f400/0x4776e02a9acf53c7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.613026:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53c0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc8b expref: 10 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.613048:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f400/0x4776e02a9acf53c7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc8b expref: 9 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.613058:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:1.0:1782480879.613061:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782480879.613065:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55f400, rc 0) 00000100:00100000:1.0:1782480879.613340:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc50000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:10250:x1869066366119296:12345-192.168.201.58@tcp:101:lctl.0 Request processed in 492us (1179us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480879.613350:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:3.0:1782480879.704946:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480879.705386:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366119424 00000100:00100000:1.0:1782480879.705399:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366119424 00000100:00100000:1.0:1782480879.705516:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:1.0:1782480879.705526:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:10256:x1869066366119424:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1782480879.705549:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480879.705574:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc92 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705651:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53d5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705704:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705716:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705748:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53dc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705755:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705761:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705887:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f200/0x4776e02a9acf53e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705895:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f200/0x4776e02a9acf53e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705901:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f200/0x4776e02a9acf53e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480879.705933:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:1.0:1782480879.705937:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480879.705978:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f200/0x4776e02a9acf53e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705991:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53d5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.705997:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53d5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706004:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706019:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55f000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480879.706024:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53d5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706031:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53d5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706045:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:1.0:1782480879.706048:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480879.706053:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706059:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706073:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53dc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706079:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53dc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706085:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706089:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480879.706092:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53dc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706097:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53dc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706115:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff91d7c8d19700) 00010000:00010000:1.0:1782480879.706118:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480879.706121:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53dc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706126:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53dc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706157:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc92 expref: 11 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706170:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f200/0x4776e02a9acf53e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc92 expref: 10 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.706177:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:1.0:1782480879.706179:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782480879.706181:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55f200, rc 0) 00000100:00100000:1.0:1782480879.706253:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc52680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:10256:x1869066366119424:12345-192.168.201.58@tcp:101:bash.0 Request processed in 728us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480879.706260:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:3.0:1782480879.717703:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480879.718104:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366119680 00000100:00100000:1.0:1782480879.718123:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366119680 00000100:00100000:1.0:1782480879.718191:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:1.0:1782480879.718201:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:10256:x1869066366119680:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1782480879.718238:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480879.718260:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53ea lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fc99 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.718450:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53f1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.718464:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.718474:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.718523:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.718531:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480879.718538:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1782480879.724863:0:6840:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:0.0:1782480879.725140:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725159:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725172:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725228:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53f1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725236:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53f1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725244:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725250:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480879.725254:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53f1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725262:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53f1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725275:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:0.0:1782480879.725278:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480879.725283:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53f1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725289:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf53f1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480879.725320:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ec916b3d reply state 00000000381f72e3 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480879.725330:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1782480879.725379:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf53ea lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc99 expref: 13 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725393:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc99 expref: 12 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.725400:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3700) 00010000:00010000:0.0:1782480879.725403:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480879.725405:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782480879.725496:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc52300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:10256:x1869066366119680:12345-192.168.201.58@tcp:101:bash.0 Request processed in 7295us (7802us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1782480879.725505:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00010000:00010000:0.0:1782480879.728610:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.728629:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.728637:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.728643:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55f000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480879.728648:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.728689:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.728706:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c8d19700) 00010000:00010000:0.0:1782480879.728710:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480879.728715:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.728721:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf53f8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480879.732110:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480879.732197:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366119808 00000100:00100000:0.0:1782480879.732208:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366119808 00000100:00100000:0.0:1782480879.732272:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:0.0:1782480879.732281:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1869066366119808:12345-192.168.201.58@tcp:8:bash.0 00010000:00080000:0.0:1782480879.732314:0:6609:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp t0 exp 0000000000000000 cur 410 last 0 00000020:00000080:0.0:1782480879.732345:0:6609:0:(genops.c:1406:class_connect()) connect: client 227f6c69-cfd7-4cc4-bae6-15b91431c78c, cookie 0x4776e02a9acf540d 00002000:00100000:0.0:1782480879.732356:0:6609:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 227f6c69-cfd7-4cc4-bae6-15b91431c78c/ffff91d7c9863800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1782480879.732390:0:6609:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1782480879.732615:0:6609:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782480879.732652:0:6609:0:(import.c:65:import_set_state_nolock()) ffff91d7c9866000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480879.732763:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc50380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2349:x1869066366119808:12345-192.168.201.58@tcp:8:bash.0 Request processed in 481us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480879.732771:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:3.0:1782480879.741630:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480879.742253:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366119936 00000100:00100000:0.0:1782480879.742267:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366119936 00000100:00100000:0.0:1782480879.742347:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:0.0:1782480879.742383:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:0:x1869066366119936:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1782480879.742403:0:8498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480879.742430:0:8498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5414 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fca0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480879.742460:0:8498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480879.742481:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=410s v=(0 0) 00010000:00010000:0.0:1782480879.742485:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480879.742494:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca0 expref: 7 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.742516:0:8498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca0 expref: 7 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.742528:0:8498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a600, rc 0) 00000100:00080000:2.0:1782480879.742686:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480879.743238:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc51880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:0:x1869066366119936:12345-192.168.201.58@tcp:101:bash.0 Request processed in 856us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480879.743246:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1782480879.756324:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480879.756600:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366120064 00000100:00100000:0.0:1782480879.756610:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366120064 00000100:00100000:0.0:1782480879.756705:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:0.0:1782480879.756716:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:10256:x1869066366120064:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1782480879.756739:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480879.756757:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fca7 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.756814:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5414 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca0 expref: 8 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.756823:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480879.756828:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480879.756833:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 4/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.756881:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca0 expref: 8 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.756895:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca0 expref: 8 pid: 8498 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480879.756910:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6609:1869066388177920:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480879.757009:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480879.761074:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480879.762376:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ca300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6609:1869066388177920:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480879.762417:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 3/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480879.762440:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b800, rc 0) 00000100:00100000:0.0:1782480879.762521:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc51c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:10256:x1869066366120064:12345-192.168.201.58@tcp:101:bash.0 Request processed in 5807us (6206us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480879.762530:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:2.0:1782480879.766090:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366120192 00000100:00100000:2.0:1782480879.766105:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366120192 00010000:00010000:2.0:1782480879.766171:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca0 expref: 8 pid: 8498 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480879.766228:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:2.0:1782480879.766238:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366120192:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480879.766254:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480879.766279:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5414 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca0 expref: 8 pid: 8498 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.766305:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5414 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca0 expref: 8 pid: 8498 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.766332:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5414 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca0 expref: 8 pid: 8498 timeout: 510 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.766352:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480879.766356:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480879.766375:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.766385:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.766955:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480879.766973:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ece6a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5787:1869066388178048:192.168.201.58@tcp:105: 00000100:00100000:2.0:1782480879.767070:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6ba2600 going to sleep for 11 seconds 00000100:00100000:2.0:1782480879.773844:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ece6a680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5787:1869066388178048:192.168.201.58@tcp:105: 00010000:00010000:2.0:1782480879.773873:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480879.773934:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc51500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366120192:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 7695us (12870us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480879.773946:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1782480879.775888:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480879.775979:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366120448 00000100:00100000:1.0:1782480879.775988:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366120448 00000100:00100000:1.0:1782480879.776051:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1782480879.776061:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:10256:x1869066366120448:12345-192.168.201.58@tcp:35:bash.0 00000001:00080000:1.0:1782480879.776470:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967312 00000100:00100000:1.0:1782480879.776984:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:10256:x1869066366120448:12345-192.168.201.58@tcp:35:bash.0 Request processed in 922us (1101us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1782480879.776993:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000020:00080000:1.0:1782480879.776998:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1782480879.876098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480879.876489:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366120704 00000100:00100000:2.0:1782480879.876499:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366120704 00000100:00100000:2.0:1782480879.876567:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:2.0:1782480879.876577:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:10266:x1869066366120704:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1782480879.876611:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480879.876633:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf5422 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fcae expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480879.876855:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:2.0:1782480879.876981:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf5422 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcae expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.876995:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:2.0:1782480879.876998:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480879.877017:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf5422 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcae expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480879.877428:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d600, rc 0) 00000100:00100000:2.0:1782480879.877573:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc52d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:10266:x1869066366120704:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 993us (1482us total) trans 4294967314 rc 301/301 00000100:00100000:2.0:1782480879.877581:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:0.0:1782480879.881619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480879.886377:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366120960 00000100:00100000:1.0:1782480879.886392:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366120960 00000100:00100000:1.0:1782480879.886485:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1782480879.886497:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:10266:x1869066366120960:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1782480879.886832:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:10266:x1869066366120960:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 336us (5219us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1782480879.886841:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1782480880.009478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480880.009640:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366121088 00000100:00100000:3.0:1782480880.009651:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366121088 00000100:00100000:3.0:1782480880.009739:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:3.0:1782480880.009749:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:10272:x1869066366121088:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480880.009776:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480880.009800:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5430 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fcb5 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.009968:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5437 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.009981:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.009991:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480880.010056:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1782480880.010061:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480880.010092:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5437 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.010120:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5430 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcb5 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.010138:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5437 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcb5 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.010146:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480880.010150:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480880.010153:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b800, rc 0) 00000100:00100000:3.0:1782480880.010726:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+17:10272:x1869066366121088:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 973us (1253us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480880.010734:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:2.0:1782480880.025332:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480880.025509:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366121344 00000100:00100000:1.0:1782480880.025521:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366121344 00000100:00100000:1.0:1782480880.025591:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:1.0:1782480880.025602:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+17:10272:x1869066366121344:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782480880.025631:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480880.025655:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf543e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fcbc expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.025793:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5445 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.025807:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.025832:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5445 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480880.025845:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782480880.026385:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf543e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcbc expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.026409:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5445 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcbc expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.026435:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3700) 00010000:00010000:1.0:1782480880.026453:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480880.026456:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55fa00, rc 0) 00000100:00100000:1.0:1782480880.026561:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:10272:x1869066366121344:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 960us (1238us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1782480880.026569:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:0.0:1782480880.049429:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480880.049783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480880.049987:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366121728 00000100:00100000:3.0:1782480880.049998:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366121728 00000100:00100000:3.0:1782480880.050076:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:3.0:1782480880.050087:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:10272:x1869066366121728:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480880.050114:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480880.050137:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5453 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fcc3 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480880.050458:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366121472 00000100:00100000:1.0:1782480880.050463:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366121472 00000100:00100000:1.0:1782480880.050509:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:1.0:1782480880.050517:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:2352:x1869066366121472:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480880.050529:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480880.050554:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5445 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcbc expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.050576:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3700) 00010000:00010000:1.0:1782480880.050582:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480880.050777:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf545a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.050792:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf545a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.050802:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf545a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480880.050895:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782480880.051076:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5453 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcc3 expref: 22 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.051092:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf545a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcc3 expref: 21 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.051100:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3700) 00010000:00010000:3.0:1782480880.051103:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782480880.051105:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779bc00, rc 0) 00000100:00100000:1.0:1782480880.051332:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:2352:x1869066366121472:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 813us (1913us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480880.051342:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:3.0:1782480880.054467:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:10272:x1869066366121728:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 4355us (4657us total) trans 4294967317 rc 0/0 00000100:00100000:3.0:1782480880.054480:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:1.0:1782480880.064433:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480880.064596:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366121856 00000100:00100000:0.0:1782480880.064608:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366121856 00000100:00100000:0.0:1782480880.064703:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:0.0:1782480880.064714:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366121856:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:0.0:1782480880.064761:0:8498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.064781:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.064790:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480880.064794:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480880.064799:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.064835:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.064850:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480880.064864:0:8498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8498:1869066388178176:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480880.064985:0:8498:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1782480880.068980:0:8498:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8498:1869066388178176:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480880.069017:0:8498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480880.069873:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480880.070287:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366121984 00000100:00100000:3.0:1782480880.070309:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366121984 00002000:00100000:3.0:1782480880.070369:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff91d8006af800 x1869066366121984/t0(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:636/0 lens 504/0 e 0 to 0 dl 1782480891 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480880.070380:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d8006af800 with x1869066366121984 ext(0->12) 00010000:00010000:3.0:1782480880.070389:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 8 pid: 6609 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.070406:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 8 pid: 6609 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480880.070414:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d8006af800 00000100:00100000:3.0:1782480880.070498:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1782480880.070509:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366121984:12345-192.168.201.58@tcp:4:lfs.0 00000001:00100000:1.0:1782480880.126644:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000001:00080000:3.0:1782480880.152635:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000100:00100000:0.0:1782480880.152760:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366121984:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 82246us (82883us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1782480880.152777:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00002000:00100000:0.0:1782480880.152790:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x2:0x0] (0->12) req@ffff91d8006af800 x1869066366121984/t4294967299(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:636/0 lens 504/448 e 0 to 0 dl 1782480891 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782480880.152800:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d8006af800 with x1869066366121984 ext(0->12) 00010000:00010000:0.0:1782480880.152812:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.152829:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480880.152838:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d8006af800 00000100:00100000:0.0:1782480880.155955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480880.156153:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366122112 00000100:00100000:2.0:1782480880.156164:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366122112 00010000:00010000:2.0:1782480880.156270:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480880.156421:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:2.0:1782480880.156433:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2352:x1869066366122112:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480880.156450:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1782480880.156471:0:5787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782480880.156474:0:5787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1782480880 00002000:00010000:2.0:1782480880.156476:0:5787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb atime from disk: 0 -> 1782480880 00002000:00010000:2.0:1782480880.156479:0:5787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1782480880 00002000:00010000:2.0:1782480880.156481:0:5787:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:2.0:1782480880.156488:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.156506:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.156555:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf541b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fca7 expref: 7 pid: 6609 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.156577:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480880.156582:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480880.156588:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.156599:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.156642:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480880.156742:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366122112:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 310us (792us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480880.156750:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00010000:00010000:1.0:1782480880.156875:0:8498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.156897:0:8498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.156925:0:8498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.156933:0:8498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.156942:0:8498:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.156949:0:8498:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782480880.156953:0:8498:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.156962:0:8498:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.156989:0:8498:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.156997:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5468 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480880.157068:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366121856:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 92355us (92647us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480880.157075:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:1.0:1782480880.159268:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480880.159369:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366122368 00000100:00100000:3.0:1782480880.159381:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366122368 00000100:00100000:3.0:1782480880.159440:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1782480880.159450:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:10272:x1869066366122368:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:3.0:1782480880.159513:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf545a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcc3 expref: 20 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480880.159840:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:3.0:1782480880.159885:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00000001:00080000:3.0:1782480880.160479:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00010000:00010000:3.0:1782480880.160540:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.160556:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc99 expref: 24 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.160570:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.160607:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc99 expref: 24 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.160623:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc99 expref: 24 pid: 6840 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480880.160639:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc50e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1869066388178304:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480880.160782:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dc806000 going to sleep for 11 seconds 00000100:00100000:1.0:1782480880.165106:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480880.165192:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc50e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1869066388178304:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480880.165223:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480880.165525:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366122496 00000100:00100000:0.0:1782480880.165535:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366122496 00010000:00010000:0.0:1782480880.165581:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc99 expref: 25 pid: 6840 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480880.165626:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:0.0:1782480880.165635:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+25:2350:x1869066366122496:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480880.165805:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480880.165816:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc99 expref: 25 pid: 6840 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.165829:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc99 expref: 25 pid: 6840 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.165852:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf53ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc99 expref: 25 pid: 6840 timeout: 510 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.165869:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3700) 00010000:00010000:0.0:1782480880.165874:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.165883:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.165890:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.166199:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480880.166262:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:2350:x1869066366122496:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 626us (1166us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480880.166272:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00010000:00010000:3.0:1782480880.167492:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.167507:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480880.167652:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000001:00080000:3.0:1782480880.168012:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1782480880.168887:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc50e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388178432:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782480880.168978:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480880.169017:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7cb731780 going to sleep for 11 seconds 00000100:00100000:2.0:1782480880.169505:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388178432 00000100:00100000:2.0:1782480880.169513:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388178432 00000100:00100000:2.0:1782480880.169587:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480880.169598:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869066388178432:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782480880.169728:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dde300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869066388178432:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 133us (762us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480880.169736:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480880.169781:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc50e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388178432:0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:1.0:1782480880.170370:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:2.0:1782480880.171202:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00000100:00100000:2.0:1782480880.171304:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ece6b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388178560:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782480880.171376:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480880.171456:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dc806000 going to sleep for 11 seconds 00000100:00100000:0.0:1782480880.171554:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388178560 00000100:00100000:0.0:1782480880.171561:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388178560 00000100:00100000:0.0:1782480880.171651:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480880.171681:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869066388178560:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782480880.171919:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1869066388178560:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 258us (541us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1782480880.171934:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1782480880.172014:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ece6b800 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388178560:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1782480880.172068:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1782480880.172109:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.172119:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.172126:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.172132:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480880.172136:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.172144:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.172159:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3700) 00010000:00010000:2.0:1782480880.172162:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1782480880.172166:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.172173:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf546f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782480880.172344:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1782480880.172566:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:2.0:1782480880.172579:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 410733918549ns, next at 411733916543ns, rc = 0 00000001:00080000:2.0:1782480880.172592:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967325 00010000:00010000:2.0:1782480880.172627:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3700) 00010000:00010000:2.0:1782480880.172631:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782480880.172637:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf545a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcc3 expref: 28 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480880.172772:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:10272:x1869066366122368:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 13323us (13512us total) trans 4294967326 rc 0/0 00000100:00100000:2.0:1782480880.172781:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000020:00080000:2.0:1782480880.172785:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1782480880.180069:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480880.180322:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366122624 00000100:00100000:0.0:1782480880.180333:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366122624 00000100:00100000:0.0:1782480880.180409:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:0.0:1782480880.180418:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:10272:x1869066366122624:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480880.180446:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480880.180472:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5476 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fcca expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.180543:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcca expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.180558:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5476 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcca expref: 28 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.180579:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:0.0:1782480880.180582:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480880.180586:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782480880.180699:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:10272:x1869066366122624:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 242us (602us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480880.180707:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:1.0:1782480880.184829:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480880.184929:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366122880 00000100:00100000:0.0:1782480880.184939:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366122880 00000100:00100000:0.0:1782480880.185193:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:0.0:1782480880.185212:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:10272:x1869066366122880:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1782480880.185467:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b64450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:10272:x1869066366122880:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 256us (647us total) trans 4294967327 rc 0/0 00000100:00100000:0.0:1782480880.185482:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:2.0:1782480880.257638:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480880.257769:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366123136 00000100:00100000:0.0:1782480880.257780:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366123136 00000100:00100000:0.0:1782480880.257848:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:0.0:1782480880.257860:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:10281:x1869066366123136:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480880.257887:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480880.257911:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf547d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fcd1 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480880.258045:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782480880.258193:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf547d lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd1 expref: 31 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.258219:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:0.0:1782480880.258223:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480880.258228:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf547d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd1 expref: 31 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.258246:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b200, rc 0) 00000100:00100000:0.0:1782480880.258304:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:10281:x1869066366123136:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 446us (680us total) trans 4294967328 rc 301/301 00000100:00100000:0.0:1782480880.258312:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:1.0:1782480880.264576:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480880.264691:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366123264 00000100:00100000:0.0:1782480880.264701:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366123264 00000100:00100000:0.0:1782480880.264752:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:0.0:1782480880.264761:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:10281:x1869066366123264:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:0.0:1782480880.264860:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf548b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.264878:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf548b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.264890:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf548b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.264906:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5492 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.264914:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.264921:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265028:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265037:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265044:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480880.265104:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265117:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf548b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265135:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf548b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265142:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf548b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265149:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480880.265153:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf548b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265161:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf548b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265174:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:0.0:1782480880.265177:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480880.265181:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf548b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265187:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf548b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265213:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5492 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265220:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5492 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265226:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265231:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480880.265241:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5492 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265247:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5492 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265255:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c32f3600) 00010000:00010000:0.0:1782480880.265258:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480880.265261:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5492 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265266:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5492 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265286:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265292:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265298:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265303:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480880.265306:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265312:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265319:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:0.0:1782480880.265321:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480880.265330:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.265336:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5499 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480880.265430:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:10281:x1869066366123264:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 667us (861us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480880.265437:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:1.0:1782480880.268293:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480880.268394:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366123520 00000100:00100000:2.0:1782480880.268403:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366123520 00000100:00100000:2.0:1782480880.268464:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1782480880.268474:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:10281:x1869066366123520:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1782480880.268765:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:10281:x1869066366123520:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 291us (481us total) trans 4294967329 rc 0/0 00000100:00100000:2.0:1782480880.268772:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1782480880.304745:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480880.304886:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366123776 00000100:00100000:0.0:1782480880.304898:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366123776 00000100:00100000:0.0:1782480880.304964:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1782480880.304974:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:10285:x1869066366123776:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480880.305002:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480880.305029:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf54a0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fcd8 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.305599:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf54a7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.305615:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf54a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.305627:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf54a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.305641:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf54ae lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.305647:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf54ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.305785:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf54ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307321:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307340:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307352:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480880.307377:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1782480880.307510:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf54a7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307518:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf54a7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307525:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf54a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307546:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480880.307552:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf54a7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307560:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf54a7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307575:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:1.0:1782480880.307579:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480880.307583:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf54a7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307590:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf54a7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307612:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf54ae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307620:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf54ae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307625:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf54ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307631:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480880.307633:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf54ae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307639:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf54ae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307767:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c32f3600) 00010000:00010000:1.0:1782480880.307770:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480880.307774:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf54ae lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307780:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf54ae lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307837:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf54a0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd8 expref: 34 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307853:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd8 expref: 33 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480880.307860:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:1.0:1782480880.307863:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480880.307866:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55ec00, rc 0) 00000100:00100000:1.0:1782480880.307970:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:10285:x1869066366123776:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2996us (3235us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1782480880.307979:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:1.0:1782480880.311515:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480880.311602:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366123904 00000100:00100000:0.0:1782480880.311613:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366123904 00000100:00100000:0.0:1782480880.311706:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:0.0:1782480880.311720:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:10285:x1869066366123904:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:0.0:1782480880.311795:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf54c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.311813:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf54c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.311826:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf54c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.311854:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf54c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.311861:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf54c3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.311868:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf54c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.311876:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480880.311881:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf54c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.311888:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf54c3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.311922:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:0.0:1782480880.311925:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480880.311930:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf54c3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.311936:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf54c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480880.312017:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:10285:x1869066366123904:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 300us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480880.312025:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:0.0:1782480880.315941:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480880.316039:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366124160 00000100:00100000:2.0:1782480880.316050:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366124160 00000100:00100000:2.0:1782480880.316113:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782480880.316125:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:10285:x1869066366124160:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1782480880.316377:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:10285:x1869066366124160:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 254us (451us total) trans 4294967331 rc 0/0 00000100:00100000:2.0:1782480880.316385:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00010000:00010000:2.0:1782480880.606970:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480880.745850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480880.746001:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366124416 00000100:00100000:3.0:1782480880.746041:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366124416 00000100:00100000:3.0:1782480880.746358:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:3.0:1782480880.746377:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:10316:x1869066366124416:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:3.0:1782480880.746418:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480880.746451:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54ca lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fcdf expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.746609:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf54d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.746628:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf54d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.746643:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf54d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480880.746700:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1782480880.746900:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54ca lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcdf expref: 37 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.746925:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf54d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcdf expref: 36 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.746936:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:3.0:1782480880.746941:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480880.746946:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ba00, rc 0) 00000100:00100000:3.0:1782480880.747044:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:10316:x1869066366124416:12345-192.168.201.58@tcp:101:cat.0 Request processed in 671us (1210us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1782480880.753256:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:1.0:1782480880.754754:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480880.755386:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366124672 00000100:00100000:2.0:1782480880.755401:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366124672 00000100:00100000:2.0:1782480880.755491:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1782480880.755503:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:10316:x1869066366124672:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:2.0:1782480880.755954:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:10316:x1869066366124672:12345-192.168.201.58@tcp:35:cat.0 Request processed in 451us (1208us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1782480880.755964:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1782480880.761693:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480880.762735:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366124800 00000100:00100000:2.0:1782480880.762753:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366124800 00000100:00100000:2.0:1782480880.762855:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:2.0:1782480880.762866:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d1302850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:2352:x1869066366124800:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480880.762887:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480880.762922:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf54d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcdf expref: 37 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.762948:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:2.0:1782480880.762954:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480880.763026:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d1302850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:2352:x1869066366124800:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 161us (1837us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480880.763036:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:1.0:1782480880.878128:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480880.878303:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366125056 00000100:00100000:0.0:1782480880.878317:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366125056 00000100:00100000:0.0:1782480880.878423:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:0.0:1782480880.878438:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:10322:x1869066366125056:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:0.0:1782480880.878478:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480880.878483:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782480880.878522:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5437 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcb5 expref: 36 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.878547:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:0.0:1782480880.878553:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480880.878575:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf54df lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fce6 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.878795:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.878830:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd8 expref: 36 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.878839:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.878885:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd8 expref: 36 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.878903:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd8 expref: 36 pid: 5802 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480880.878920:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388178688:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480880.879049:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c4a12cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480880.888727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480880.889789:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366125184 00000100:00100000:2.0:1782480880.889805:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366125184 00010000:00010000:2.0:1782480880.889877:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd8 expref: 37 pid: 5802 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480880.889950:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:2.0:1782480880.889987:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:2351:x1869066366125184:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480880.890012:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480880.890022:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd8 expref: 37 pid: 5802 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.890039:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd8 expref: 37 pid: 5802 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.890074:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:2.0:1782480880.890081:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.890105:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.890116:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480880.890150:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480880.890249:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:2351:x1869066366125184:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 265us (1593us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480880.890258:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00010000:00010000:0.0:1782480880.891923:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf54b5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcd8 expref: 36 pid: 5802 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480880.891954:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388178688:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480880.891986:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.891997:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.892003:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480880.892032:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1782480880.892365:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf54df lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fce6 expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.892384:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fce6 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480880.892394:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:0.0:1782480880.892398:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782480880.892402:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b600, rc 0) 00000100:00100000:0.0:1782480880.892497:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:10322:x1869066366125056:12345-192.168.201.58@tcp:101:dd.0 Request processed in 14062us (14386us total) trans 4294967334 rc 0/0 00000100:00100000:0.0:1782480880.892507:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:1.0:1782480880.911059:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480880.911238:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366125440 00000100:00100000:3.0:1782480880.911253:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366125440 00000100:00100000:3.0:1782480880.911333:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:3.0:1782480880.911379:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:10322:x1869066366125440:12345-192.168.201.58@tcp:36:dd.0 00010000:00010000:3.0:1782480880.911850:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.911874:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.911888:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480880.911954:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967335 00000004:00010000:3.0:1782480880.911980:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002d865ca8 reply state 00000000e1cb8554 transno 4294967336 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480880.911991:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480880.912136:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+39:10322:x1869066366125440:12345-192.168.201.58@tcp:36:dd.0 Request processed in 788us (1088us total) trans 4294967336 rc 0/0 00000100:00100000:3.0:1782480880.912144:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00000020:00080000:3.0:1782480880.912151:0:5802:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782480880.916171:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.916207:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.916217:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.916225:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480880.916255:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.916266:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.916291:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:3.0:1782480880.916296:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480880.916302:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480880.916309:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf54f4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480881.312054:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782480881.406634:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480881.406788:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366125568 00000100:00100000:2.0:1782480881.406803:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366125568 00000100:00100000:2.0:1782480881.406991:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:2.0:1782480881.407008:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:10336:x1869066366125568:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:2.0:1782480881.407049:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480881.407103:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf54fb lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fced expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.407209:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5502 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.407226:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.407241:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.407260:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5509 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.407268:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.407274:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.409941:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.409975:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fce6 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.409985:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.410054:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fce6 expref: 39 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480881.410115:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fce6 expref: 39 pid: 5804 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480881.410136:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ece69180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388178816:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480881.410279:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dc806600 going to sleep for 11 seconds 00000100:00080000:1.0:1782480881.419052:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480881.421079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480881.421324:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366125824 00000100:00100000:0.0:1782480881.421347:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366125824 00000100:00100000:0.0:1782480881.421441:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1782480881.421454:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+40:5566:x1869066366125824:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782480881.421999:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:5566:x1869066366125824:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 544us (929us total) trans 4294967337 rc 0/0 00000100:00100000:0.0:1782480881.422010:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1782480881.422534:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ece69180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388178816:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480881.422569:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480881.425855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480881.426167:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366125952 00000100:00100000:3.0:1782480881.426253:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366125952 00010000:00010000:3.0:1782480881.426313:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fce6 expref: 41 pid: 5804 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480881.426367:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:3.0:1782480881.426378:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:2351:x1869066366125952:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480881.426396:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480881.426404:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fce6 expref: 41 pid: 5804 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.426418:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fce6 expref: 41 pid: 5804 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.426445:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf54e6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fce6 expref: 41 pid: 5804 timeout: 511 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.426497:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:3.0:1782480881.426504:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.426513:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.426522:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.426555:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480881.426625:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece68000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+40:2351:x1869066366125952:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 248us (789us total) trans 0 rc 0/0 00010000:00010000:1.0:1782480881.426631:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480881.426640:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00010000:00010000:1.0:1782480881.426656:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480881.426788:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782480881.426794:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480881.426853:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.426875:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.426891:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5502 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.426900:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5502 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.426907:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.426914:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2c200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480881.426920:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5502 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.426931:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5502 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.426966:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:1.0:1782480881.426970:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480881.426976:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5502 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.426983:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5502 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.427004:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5509 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.427011:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5509 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.427017:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.427021:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480881.427023:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5509 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.427027:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5509 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.427034:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c610be00) 00010000:00010000:1.0:1782480881.427037:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480881.427040:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5509 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.427046:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5509 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.427115:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf54fb lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fced expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.427447:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fced expref: 40 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480881.427457:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:1.0:1782480881.427459:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480881.427462:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2c600, rc 0) 00000100:00100000:1.0:1782480881.427558:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+40:10336:x1869066366125568:12345-192.168.201.58@tcp:101:stat.0 Request processed in 20554us (20938us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480881.427570:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:2.0:1782480881.534482:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480881.534928:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366126208 00000100:00100000:3.0:1782480881.534942:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366126208 00000100:00100000:3.0:1782480881.535028:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:3.0:1782480881.535043:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+39:10342:x1869066366126208:12345-192.168.201.58@tcp:36:truncate.0 00010000:00010000:3.0:1782480881.535140:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480881.535191:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf5510 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fced expref: 39 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.535222:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:3.0:1782480881.535229:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480881.537624:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.537656:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.538944:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480881.539126:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967338 00000004:00010000:3.0:1782480881.541524:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a596da54 reply state 0000000008055c7b transno 4294967339 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480881.541551:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480881.541816:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:10342:x1869066366126208:12345-192.168.201.58@tcp:36:truncate.0 Request processed in 6769us (7343us total) trans 4294967339 rc 0/0 00000100:00100000:3.0:1782480881.541827:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 54 00000020:00080000:3.0:1782480881.541835:0:5802:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782480881.548237:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480881.548263:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480881.548272:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480881.548280:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480881.548307:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480881.548317:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480881.548361:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:0.0:1782480881.548365:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480881.548371:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480881.548378:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5517 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480881.566981:0:7851:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 412128318555ns, next at 413128315670ns, rc = 0 00000100:00100000:2.0:1782480881.567226:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782480881.567257:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388178944:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480881.567367:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480881.567613:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388178944 00000100:00100000:1.0:1782480881.567623:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388178944 00000100:00100000:1.0:1782480881.567726:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1782480881.567737:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1869066388178944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480881.567783:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480881.567842:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1869066388178944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 106us (475us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480881.567850:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782480881.568029:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388178944:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480881.568969:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388179456:0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569037:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480881.569077:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1782480881.569095:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388179072:0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569129:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480881.569161:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388179584:0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569195:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480881.569226:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388179200:0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569254:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480881.569276:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782480881.569281:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388179328:0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569306:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480881.569350:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388179456 00000100:00100000:3.0:1782480881.569366:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388179456 00000100:00100000:3.0:1782480881.569432:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782480881.569441:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388179456:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569499:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388179456:12345-0@lo:400:kworker.0 Request processed in 59us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480881.569507:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782480881.569534:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388179072 00000100:00100000:3.0:1782480881.569537:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388179072 00000100:00100000:3.0:1782480881.569555:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1782480881.569559:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388179072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569581:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388179072:12345-0@lo:400:kworker.0 Request processed in 23us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480881.569585:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 294 00000100:00100000:3.0:1782480881.569625:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388179072:0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569634:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388179456:0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569683:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388179584 00000100:00100000:3.0:1782480881.569685:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388179584 00000100:00100000:3.0:1782480881.569707:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388179200 00000100:00100000:3.0:1782480881.569708:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388179200 00000100:00100000:3.0:1782480881.569715:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388179328 00000100:00100000:3.0:1782480881.569717:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388179328 00000100:00100000:3.0:1782480881.569725:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782480881.569729:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388179584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569752:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388179584:12345-0@lo:400:kworker.0 Request processed in 23us (557us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480881.569756:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1782480881.569763:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782480881.569772:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388179200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569793:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388179200:12345-0@lo:400:kworker.0 Request processed in 21us (539us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480881.569797:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1782480881.569804:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782480881.569807:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388179328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569821:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388179328:12345-0@lo:400:kworker.0 Request processed in 13us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480881.569824:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:3.0:1782480881.569839:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388179328:0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569845:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388179200:0@lo:400:kworker.0 00000100:00100000:3.0:1782480881.569859:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388179584:0@lo:400:kworker.0 00000100:00080000:3.0:1782480881.569874:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480881.569878:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782480881.631225:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480881.835987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480881.842016:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366126336 00000100:00100000:3.0:1782480881.842037:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366126336 00000100:00100000:3.0:1782480881.842156:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:3.0:1782480881.842180:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+40:10356:x1869066366126336:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:3.0:1782480881.842218:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480881.842248:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf551e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fcf4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.842361:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5525 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.842382:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5525 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.842426:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5525 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.842448:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf552c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.842457:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf552c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.842464:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf552c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.842988:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843001:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843009:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480881.843062:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:3.0:1782480881.843067:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480881.843099:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843113:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843123:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5525 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843143:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5525 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843150:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5525 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843158:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480881.843164:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5525 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843228:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5525 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843244:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480881.843247:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480881.843254:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5525 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843260:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5525 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843276:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf552c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843282:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf552c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843287:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf552c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843297:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480881.843306:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf552c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843314:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf552c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843322:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1e00) 00010000:00010000:3.0:1782480881.843325:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480881.843338:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf552c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843343:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf552c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843393:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf551e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcf4 expref: 42 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843408:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcf4 expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.843415:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:3.0:1782480881.843417:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480881.843420:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b200, rc 0) 00000100:00100000:3.0:1782480881.843522:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:10356:x1869066366126336:12345-192.168.201.58@tcp:101:stat.0 Request processed in 1355us (7909us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480881.843531:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:2.0:1782480881.932171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480881.932362:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366126592 00000100:00100000:3.0:1782480881.932376:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366126592 00000100:00100000:3.0:1782480881.932520:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:3.0:1782480881.932533:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:10366:x1869066366126592:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480881.932582:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480881.932622:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf553a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fcfb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480881.932868:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:3.0:1782480881.933036:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf553a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcfb expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.933056:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:3.0:1782480881.933060:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480881.933067:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf553a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcfb expref: 43 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480881.933087:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a400, rc 0) 00000100:00100000:3.0:1782480881.933163:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+42:10366:x1869066366126592:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 632us (1007us total) trans 4294967340 rc 301/301 00000100:00100000:3.0:1782480881.933186:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:2.0:1782480881.940918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480881.941069:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366126848 00000100:00100000:0.0:1782480881.941082:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366126848 00000100:00100000:0.0:1782480881.941161:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1782480881.941174:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+42:10366:x1869066366126848:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1782480881.941536:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+43:10366:x1869066366126848:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 363us (631us total) trans 4294967341 rc 0/0 00000100:00100000:0.0:1782480881.941544:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1782480882.004764:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480882.008620:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366127104 00000100:00100000:3.0:1782480882.008636:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366127104 00000100:00100000:3.0:1782480882.008866:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:3.0:1782480882.008878:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+43:10372:x1869066366127104:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1782480882.008906:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480882.008929:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5548 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd02 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.009039:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.009403:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcf4 expref: 44 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.009413:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.009449:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcf4 expref: 44 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.009463:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcf4 expref: 44 pid: 5803 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.009478:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388179712:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480882.009588:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6ba2900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480882.013579:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388179712:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480882.013611:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480882.014900:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480882.015294:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366127232 00000100:00100000:3.0:1782480882.015304:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366127232 00010000:00010000:3.0:1782480882.015361:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcf4 expref: 45 pid: 5803 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.015405:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:3.0:1782480882.015414:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+45:2351:x1869066366127232:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480882.015430:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480882.015437:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcf4 expref: 45 pid: 5803 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.015450:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcf4 expref: 45 pid: 5803 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.015481:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5533 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcf4 expref: 45 pid: 5803 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.015497:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:3.0:1782480882.015502:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.015512:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.015520:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.015548:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480882.015606:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+44:2351:x1869066366127232:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 193us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480882.015614:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00010000:00010000:1.0:1782480882.016369:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.016381:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480882.016400:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1782480882.016563:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5548 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd02 expref: 45 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.016581:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd02 expref: 44 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.016588:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:1.0:1782480882.016591:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782480882.016593:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a400, rc 0) 00000100:00100000:1.0:1782480882.016642:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+44:10372:x1869066366127104:12345-192.168.201.58@tcp:101:bash.0 Request processed in 7767us (11988us total) trans 4294967342 rc 0/0 00000100:00100000:1.0:1782480882.016650:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:1.0:1782480882.018944:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480882.019027:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366127488 00000100:00100000:0.0:1782480882.019035:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366127488 00000100:00100000:0.0:1782480882.019107:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:0.0:1782480882.019117:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+44:10372:x1869066366127488:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:0.0:1782480882.019405:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.019422:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.019447:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480882.019504:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967343 00000004:00010000:0.0:1782480882.019528:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000088ec1610 reply state 00000000e394e76c transno 4294967344 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480882.019538:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480882.019635:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+47:10372:x1869066366127488:12345-192.168.201.58@tcp:36:bash.0 Request processed in 518us (698us total) trans 4294967344 rc 0/0 00000100:00100000:0.0:1782480882.019643:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00000020:00080000:0.0:1782480882.019647:0:6840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782480882.022949:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.022967:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.022974:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.022980:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480882.022985:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.022993:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.023028:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:2.0:1782480882.023031:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480882.023036:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.023042:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf555d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480882.025976:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480882.026136:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366127616 00000100:00100000:0.0:1782480882.026146:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366127616 00000100:00100000:0.0:1782480882.026204:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:0.0:1782480882.026214:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+46:10372:x1869066366127616:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1782480882.026238:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480882.026260:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5564 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd09 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.026353:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.026368:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd02 expref: 47 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.026378:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.026429:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd02 expref: 47 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.026442:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd02 expref: 47 pid: 5803 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480882.026454:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388179840:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480882.026540:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c4a126c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480882.032885:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480882.033163:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ff800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388179840:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480882.033197:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366127744 00000100:00100000:1.0:1782480882.033205:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366127744 00010000:00010000:1.0:1782480882.033246:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd02 expref: 48 pid: 5803 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.033252:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480882.033286:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:1.0:1782480882.033312:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+48:2350:x1869066366127744:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480882.033338:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480882.033346:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd02 expref: 48 pid: 5803 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.033358:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd02 expref: 48 pid: 5803 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.033383:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf554f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd02 expref: 48 pid: 5803 timeout: 512 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.033400:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:1.0:1782480882.033404:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.033414:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.033422:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480882.033451:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480882.033489:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.033497:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480882.033507:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+47:2350:x1869066366127744:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 196us (634us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480882.033514:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000004:00200000:0.0:1782480882.033547:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782480882.033551:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480882.033574:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.033603:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5564 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd09 expref: 47 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.033621:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd09 expref: 46 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.033640:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:0.0:1782480882.033643:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480882.033645:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b200, rc 0) 00000100:00100000:0.0:1782480882.036067:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed019f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+46:10372:x1869066366127616:12345-192.168.201.58@tcp:101:bash.0 Request processed in 9838us (10086us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.036081:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:3.0:1782480882.050080:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480882.050266:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366128000 00000100:00100000:0.0:1782480882.050276:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366128000 00000100:00100000:0.0:1782480882.050346:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1782480882.050357:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+46:10372:x1869066366128000:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:0.0:1782480882.050625:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b66050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+47:10372:x1869066366128000:12345-192.168.201.58@tcp:35:bash.0 Request processed in 268us (558us total) trans 4294967345 rc 0/0 00000100:00100000:0.0:1782480882.050633:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:2.0:1782480882.160575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480882.161114:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366128256 00000100:00100000:0.0:1782480882.161125:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366128256 00000100:00100000:0.0:1782480882.161193:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:0.0:1782480882.161204:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+47:10382:x1869066366128256:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480882.161230:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480882.161253:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5572 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd10 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480882.161391:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1782480882.161511:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5572 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd10 expref: 49 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.161538:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:0.0:1782480882.161540:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480882.161544:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5572 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd10 expref: 49 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.161561:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b800, rc 0) 00000100:00100000:0.0:1782480882.161630:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+48:10382:x1869066366128256:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 430us (1068us total) trans 4294967346 rc 301/301 00000100:00100000:0.0:1782480882.161636:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:1.0:1782480882.169268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480882.169374:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366128384 00000100:00100000:3.0:1782480882.169384:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366128384 00000100:00100000:3.0:1782480882.169452:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:3.0:1782480882.169463:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+48:10382:x1869066366128384:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1782480882.169543:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5580 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169560:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169590:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169607:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5587 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169615:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169622:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169778:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169788:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169795:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480882.169841:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169854:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5580 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169862:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5580 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169868:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5580 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169886:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480882.169891:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5580 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169898:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5580 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169910:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480882.169914:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480882.169919:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5580 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169925:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5580 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169938:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5587 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169944:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5587 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169950:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169955:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480882.169958:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5587 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169964:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5587 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169983:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1e00) 00010000:00010000:3.0:1782480882.169986:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480882.169989:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5587 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.169995:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5587 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.170013:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.170019:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.170026:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.170031:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480882.170034:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.170039:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.170047:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:3.0:1782480882.170049:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480882.170052:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.170058:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf558e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.170148:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed019180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+48:10382:x1869066366128384:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 685us (887us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480882.170157:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:2.0:1782480882.175122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480882.175279:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366128640 00000100:00100000:0.0:1782480882.175290:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366128640 00000100:00100000:0.0:1782480882.175364:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1782480882.175376:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+48:10382:x1869066366128640:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1782480882.176395:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+49:10382:x1869066366128640:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 1012us (1274us total) trans 4294967347 rc 0/0 00000100:00100000:0.0:1782480882.176406:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:2.0:1782480882.208204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480882.208424:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366128896 00000100:00100000:0.0:1782480882.208436:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366128896 00000100:00100000:0.0:1782480882.208497:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:0.0:1782480882.208507:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+49:10385:x1869066366128896:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480882.208536:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480882.208561:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5595 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd17 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.208640:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf559c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.208721:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf559c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.208733:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf559c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.208749:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.208757:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.208763:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.208894:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf55aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.208903:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf55aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.208910:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf55aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480882.208921:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1782480882.209030:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf559c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209038:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf559c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209045:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf559c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209069:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480882.209074:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf559c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209083:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf559c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209096:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:0.0:1782480882.209099:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480882.209104:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf559c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209109:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf559c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209121:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209127:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55a3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209132:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209137:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480882.209139:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209144:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55a3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209160:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480882.209355:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480882.209359:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209366:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209422:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5595 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd17 expref: 52 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209437:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf55aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd17 expref: 51 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.209445:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:0.0:1782480882.209447:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480882.209449:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b600, rc 0) 00000100:00100000:0.0:1782480882.209519:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:10385:x1869066366128896:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1013us (1327us total) trans 4294967348 rc 0/0 00000100:00100000:0.0:1782480882.209527:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:1.0:1782480882.217349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480882.217391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480882.217469:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366129024 00000100:00100000:3.0:1782480882.217478:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366129024 00000100:00100000:3.0:1782480882.217540:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:3.0:1782480882.217550:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:10385:x1869066366129024:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1782480882.217623:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55b8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.217640:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.217650:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.217711:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55b8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.217718:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55b8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.217725:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.217731:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480882.217735:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55b8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.217742:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55b8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.217772:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:3.0:1782480882.217775:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480882.217780:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55b8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.217787:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55b8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480882.217866:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed018700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:10385:x1869066366129024:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 318us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480882.217874:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:2.0:1782480882.218415:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366129152 00000100:00100000:2.0:1782480882.218421:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366129152 00000100:00100000:2.0:1782480882.218467:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:2.0:1782480882.218475:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:2352:x1869066366129152:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480882.218488:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480882.218506:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf55aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd17 expref: 51 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480882.218522:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:2.0:1782480882.218526:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480882.218559:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed018000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+50:2352:x1869066366129152:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 85us (1167us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480882.218565:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:1.0:1782480882.222197:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480882.222299:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366129408 00000100:00100000:2.0:1782480882.222310:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366129408 00000100:00100000:2.0:1782480882.222379:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1782480882.222388:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+50:10385:x1869066366129408:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1782480882.222685:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:10385:x1869066366129408:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 296us (498us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1782480882.222694:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1782480882.351943:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480882.352080:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366129664 00000100:00100000:0.0:1782480882.352091:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366129664 00000100:00100000:0.0:1782480882.352156:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:0.0:1782480882.352175:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:10403:x1869066366129664:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:0.0:1782480882.352200:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480882.352220:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55bf lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd1e expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.352359:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55c6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.352373:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.352383:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55c6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480882.352393:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1782480882.352519:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55bf lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd1e expref: 54 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.352547:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55c6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd1e expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.352558:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:0.0:1782480882.352561:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1782480882.352563:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297be00, rc 0) 00000100:00100000:0.0:1782480882.352624:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10403:x1869066366129664:12345-192.168.201.58@tcp:101:cat.0 Request processed in 460us (693us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1782480882.352631:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:1.0:1782480882.377720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480882.377889:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366129792 00000100:00100000:3.0:1782480882.377899:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366129792 00000100:00100000:3.0:1782480882.377970:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:3.0:1782480882.377988:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10404:x1869066366129792:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480882.378023:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480882.378046:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55d4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd25 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.378127:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf55db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.378144:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf55db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.378170:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf55db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480882.378491:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1782480882.378495:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480882.378521:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf55db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.378548:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf55d4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd25 expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.378791:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf55db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd25 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.378798:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480882.378800:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480882.378803:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a200, rc 0) 00000100:00100000:3.0:1782480882.378899:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed019500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10404:x1869066366129792:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 917us (1188us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480882.378907:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:1.0:1782480882.390264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480882.399979:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366130176 00000100:00100000:2.0:1782480882.400007:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366130176 00000100:00100000:2.0:1782480882.400095:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:2.0:1782480882.400105:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10404:x1869066366130176:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1782480882.400586:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10404:x1869066366130176:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 479us (10329us total) trans 4294967351 rc 0/0 00000100:00100000:2.0:1782480882.400594:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:2.0:1782480882.404803:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480882.404939:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366130304 00000100:00100000:3.0:1782480882.404949:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366130304 00000100:00100000:3.0:1782480882.405152:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1782480882.405225:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10404:x1869066366130304:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:3.0:1782480882.405243:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782480882.405267:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf556b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd09 expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.405294:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf55c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd1e expref: 54 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.405338:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5476 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fcca expref: 53 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480882.405348:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3000) 00010000:00010000:3.0:1782480882.405363:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480882.405472:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece69180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:10404:x1869066366130304:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 311us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480882.405480:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1782480882.408026:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480882.408363:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366130432 00000100:00100000:0.0:1782480882.408374:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366130432 00000100:00100000:0.0:1782480882.408442:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:0.0:1782480882.408452:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:10404:x1869066366130432:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:0.0:1782480882.408586:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55e2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.408606:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.408614:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782480882.408910:0:5804:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782480882.409067:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:0.0:1782480882.409151:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:0.0:1782480882.409252:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:10404:x1869066366130432:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 800us (1232us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.409261:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:1.0:1782480882.435072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480882.435375:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366130560 00000100:00100000:0.0:1782480882.435386:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366130560 00000100:00100000:0.0:1782480882.435446:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:0.0:1782480882.435455:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:10406:x1869066366130560:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480882.435478:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480882.435500:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf55e9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd2c expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435567:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf55f0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435582:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf55f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435594:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf55f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435630:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf55f7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435637:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf55f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435644:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf55f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435764:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435772:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435779:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480882.435815:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:0.0:1782480882.435818:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480882.435835:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435844:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435851:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf55f0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435857:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf55f0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435874:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf55f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435880:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480882.435884:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf55f0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435892:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf55f0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435904:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:0.0:1782480882.435906:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480882.435911:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf55f0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435918:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf55f0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435929:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf55f7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435935:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf55f7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435941:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf55f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435946:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480882.435949:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf55f7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435965:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf55f7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435972:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c32f3200) 00010000:00010000:0.0:1782480882.435974:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480882.435977:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf55f7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.435983:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf55f7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.436014:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf55e9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd2c expref: 54 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.436026:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd2c expref: 53 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480882.436033:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480882.436035:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480882.436037:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782480882.436101:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10406:x1869066366130560:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 647us (1053us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480882.436108:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00010000:00010000:3.0:1782480882.655175:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782480883.352596:0:11879:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480883.352606:0:11879:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480883.352649:0:11879:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1782480883.352655:0:11879:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1782480883.363786:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480883.363797:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480883.363840:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1782480883.363847:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480883.364107:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388179968:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782480883.364251:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c4a12f00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480883.386526:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480883.386566:0:5814:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366130688 00000100:00100000:2.0:1782480883.386574:0:5814:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366130688 00000100:00100000:2.0:1782480883.386633:0:5814:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:2.0:1782480883.386645:0:5814:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10417:x1869066366130688:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 00000100:00100000:3.0:1782480883.386742:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388179968:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782480883.387373:0:5814:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10417:x1869066366130688:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 Request processed in 730us (857us total) trans 0 rc 0/0 00000100:00080000:3.0:1782480883.388428:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480883.396628:0:5814:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:1.0:1782480883.396941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480883.397008:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366130816 00000100:00100000:2.0:1782480883.397018:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366130816 00000100:00100000:2.0:1782480883.397068:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:2.0:1782480883.397078:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10417:x1869066366130816:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782480883.397109:0:6840:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782480883.397242:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed019c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10417:x1869066366130816:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 165us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480883.397255:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:3.0:1782480883.400263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480883.400464:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366130944 00000100:00100000:1.0:1782480883.400474:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366130944 00000100:00100000:1.0:1782480883.400536:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:1.0:1782480883.400546:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10417:x1869066366130944:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782480883.400623:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5605 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400641:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5605 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400653:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5605 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400727:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf560c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400735:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf560c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400743:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf560c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400802:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400811:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400817:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480883.400856:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1782480883.400861:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480883.400874:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400885:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5605 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400892:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5605 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400900:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5605 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400906:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55fa00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480883.400910:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5605 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400917:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5605 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400928:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:1.0:1782480883.400936:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480883.400941:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5605 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400948:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5605 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400962:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf560c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400967:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf560c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400972:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf560c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400977:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55fe00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480883.400980:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf560c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400985:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf560c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.400992:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff91d7c8d19300) 00010000:00010000:1.0:1782480883.400995:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480883.400998:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf560c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.401004:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf560c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.401018:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.401031:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.401036:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.401040:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480883.401043:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.401049:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.401056:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:1.0:1782480883.401058:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480883.401060:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.401065:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf5613 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480883.401134:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10417:x1869066366130944:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 589us (880us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480883.401154:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:2.0:1782480883.418862:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480883.422088:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366131200 00000100:00100000:2.0:1782480883.422105:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366131200 00000100:00100000:2.0:1782480883.422198:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:2.0:1782480883.422209:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10417:x1869066366131200:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782480883.422230:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480883.422253:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf561a lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd33 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422399:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5621 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422420:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422437:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480883.422455:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1782480883.422616:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5621 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422624:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5621 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422630:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422636:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480883.422652:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5621 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422689:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5621 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422702:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:2.0:1782480883.422706:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480883.422711:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5621 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422718:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5621 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422774:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf561a lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd33 expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422785:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:2.0:1782480883.422788:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480883.422792:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf561a lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd33 expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.422803:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2dc00, rc 0) 00000100:00100000:2.0:1782480883.422897:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10417:x1869066366131200:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 689us (4045us total) trans 4294967352 rc 301/301 00000100:00100000:2.0:1782480883.422906:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:1.0:1782480883.445773:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480883.446097:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366131328 00000100:00100000:0.0:1782480883.446108:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366131328 00000100:00100000:0.0:1782480883.446182:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:0.0:1782480883.446192:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10417:x1869066366131328:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782480883.446230:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782480883.446346:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed019880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10417:x1869066366131328:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 155us (595us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480883.446353:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:2.0:1782480883.451960:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480883.452444:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366131584 00000100:00100000:1.0:1782480883.452455:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366131584 00000100:00100000:1.0:1782480883.452713:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:1.0:1782480883.452725:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10417:x1869066366131584:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480883.452763:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480883.452766:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782480883.452794:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf55db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd25 expref: 54 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.452812:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:1.0:1782480883.452817:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480883.452829:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf562f lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd3a expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480883.453231:0:6840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:1.0:1782480883.453456:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5636 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.453469:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.453478:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5636 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.453548:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf562f lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd3a expref: 56 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.453565:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5636 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd3a expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.453573:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c8d19300) 00010000:00010000:1.0:1782480883.453576:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480883.453587:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55fe00, rc 0) 00000100:00100000:1.0:1782480883.453652:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc51500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10417:x1869066366131584:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 928us (1699us total) trans 4294967353 rc 0/0 00000100:00100000:1.0:1782480883.460320:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:1.0:1782480883.463160:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480883.463202:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366131840 00000100:00100000:1.0:1782480883.463212:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366131840 00000100:00100000:1.0:1782480883.463265:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:1.0:1782480883.463274:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10417:x1869066366131840:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782480883.463348:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480883.463375:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5636 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd3a expref: 55 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463394:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c8d19300) 00010000:00010000:1.0:1782480883.463404:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480883.463426:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf5644 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463438:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf5644 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463446:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf5644 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463481:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf564b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x80983a15 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463488:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf564b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x80983a15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463508:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf564b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x80983a15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463717:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf5644 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463725:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf5644 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463732:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf5644 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463744:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55f000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480883.463749:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf5644 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463756:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf5644 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463765:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:1.0:1782480883.463768:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480883.463772:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf5644 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463778:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf5644 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463788:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf564b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x80983a15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463794:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf564b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80983a15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463807:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf564b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80983a15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463812:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ea00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480883.463815:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf564b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80983a15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463821:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf564b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x80983a15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463829:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x80983a15 (ffff91d7c8d19b00) 00010000:00010000:1.0:1782480883.463831:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480883.463834:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf564b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x80983a15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.463839:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf564b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x80983a15 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480883.463929:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed018380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10417:x1869066366131840:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 654us (787us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782480883.463936:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:2.0:1782480883.474413:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.474543:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366131968 00000100:00100000:3.0:1782480883.474561:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366131968 00000100:00100000:3.0:1782480883.474621:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:3.0:1782480883.474631:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10417:x1869066366131968:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480883.474652:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480883.474701:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5652 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd41 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.474739:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.474752:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.475094:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.475205:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5652 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd41 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.475225:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd41 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.475233:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c51d1e00) 00010000:00010000:3.0:1782480883.475237:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782480883.475241:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a600, rc 0) 00000100:00100000:3.0:1782480883.475322:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc50e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10417:x1869066366131968:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 690us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480883.475330:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:3.0:1782480883.481222:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480883.481276:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366132224 00000100:00100000:1.0:1782480883.481287:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366132224 00000100:00100000:1.0:1782480883.481360:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:1.0:1782480883.481370:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10417:x1869066366132224:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782480883.481459:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.481475:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.481500:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480883.482252:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 88 off8408 00000004:00080000:1.0:1782480883.482266:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 414043605904ns, next at 415043603471ns, rc = 0 00000004:00010000:1.0:1782480883.482371:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000606f79e0 reply state 000000003f61504d transno 4294967354 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480883.482383:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782480883.482502:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+57:10417:x1869066366132224:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1130us (1286us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1782480883.482509:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00010000:00010000:0.0:1782480883.483998:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.484015:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.484023:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.484029:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55fc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480883.484034:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.484042:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.484060:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c51d1e00) 00010000:00010000:0.0:1782480883.484063:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782480883.484067:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.484225:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5660 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480883.485167:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480883.485263:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366132352 00000100:00100000:2.0:1782480883.485273:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366132352 00000100:00100000:2.0:1782480883.485339:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:2.0:1782480883.485348:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+56:10417:x1869066366132352:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782480883.485371:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480883.485389:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5667 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd48 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.485451:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd48 expref: 57 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.485466:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd48 expref: 57 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.485486:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c51d1e00) 00010000:00010000:2.0:1782480883.485489:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782480883.485491:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d800, rc 0) 00000100:00100000:2.0:1782480883.485621:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+57:10417:x1869066366132352:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 275us (459us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480883.485626:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:3.0:1782480883.488183:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.488213:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366132480 00000100:00100000:3.0:1782480883.488222:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366132480 00000100:00100000:3.0:1782480883.488257:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:3.0:1782480883.488265:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2349:x1869066366132480:12345-192.168.201.58@tcp:8:lhsmtool_posix.0 00010000:00080000:3.0:1782480883.488295:0:6608:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp t0 exp 0000000000000000 cur 414 last 0 00000020:00000080:3.0:1782480883.488340:0:6608:0:(genops.c:1406:class_connect()) connect: client 227f6c69-cfd7-4cc4-bae6-15b91431c78c, cookie 0x4776e02a9acf566e 00002000:00100000:3.0:1782480883.488354:0:6608:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 227f6c69-cfd7-4cc4-bae6-15b91431c78c/ffff91d7d1fcc000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782480883.488382:0:6608:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782480883.489029:0:6608:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1782480883.489060:0:6608:0:(import.c:65:import_set_state_nolock()) ffff91d7efc98800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782480883.489181:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2349:x1869066366132480:12345-192.168.201.58@tcp:8:lhsmtool_posix.0 Request processed in 915us (1006us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480883.489190:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:3.0:1782480883.493016:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480883.493109:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366132608 00000100:00100000:2.0:1782480883.493120:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366132608 00000100:00100000:2.0:1782480883.493192:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:2.0:1782480883.493203:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:0:x1869066366132608:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00080000:3.0:1782480883.496235:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:0.0:1782480883.575069:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000001:00100000:0.0:1782480883.575092:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000100:00100000:2.0:1782480883.575618:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:0:x1869066366132608:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 82409us (82605us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1782480883.575629:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:2.0:1782480883.602542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480883.602687:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366132864 00000100:00100000:0.0:1782480883.602699:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366132864 00000100:00100000:0.0:1782480883.602767:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1782480883.602781:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+57:10417:x1869066366132864:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782480883.603097:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+58:10417:x1869066366132864:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 319us (567us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1782480883.603105:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:2.0:1782480883.612537:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.612871:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366133120 00000100:00100000:3.0:1782480883.612893:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366133120 00000100:00100000:3.0:1782480883.612997:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:3.0:1782480883.613012:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+58:10417:x1869066366133120:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782480883.613569:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb74e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+58:10417:x1869066366133120:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 558us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480883.613580:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:3.0:1782480883.639957:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.640020:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366133248 00000100:00100000:3.0:1782480883.640033:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366133248 00000100:00100000:3.0:1782480883.640108:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:3.0:1782480883.640119:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+58:10417:x1869066366133248:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480883.640164:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480883.640279:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5675 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd4f expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.640405:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf567c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.640425:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf567c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.640442:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf567c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480883.640508:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480883.640532:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf567c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.640568:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5675 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd4f expref: 60 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.640589:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf567c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd4f expref: 59 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.640599:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c51d1e00) 00010000:00010000:3.0:1782480883.640603:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782480883.640609:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a200, rc 0) 00000100:00100000:3.0:1782480883.640731:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:10417:x1869066366133248:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 612us (792us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480883.640739:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:3.0:1782480883.645632:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.645708:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366133376 00000100:00100000:3.0:1782480883.645722:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366133376 00000100:00100000:3.0:1782480883.645800:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:3.0:1782480883.645817:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366133376:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480883.645850:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480883.645892:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf5683 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd56 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480883.645932:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e7ff3, blocks: 0x1 00010000:00010000:3.0:1782480883.645989:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1782480883.645995:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480883.646010:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf5683 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd56 expref: 6 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.646038:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf5683 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd56 expref: 6 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.646057:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a400, rc 0) 00000100:00100000:3.0:1782480883.646137:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366133376:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 324us (521us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480883.647351:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:3.0:1782480883.665308:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480883.665553:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366133632 00000100:00100000:2.0:1782480883.665582:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366133632 00000100:00100000:2.0:1782480883.665691:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:2.0:1782480883.665703:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:10417:x1869066366133632:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782480883.665851:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:10417:x1869066366133632:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 150us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480883.665859:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00010000:00010000:3.0:1782480883.679467:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480883.681808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.681847:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366133760 00000100:00100000:3.0:1782480883.681858:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366133760 00000100:00100000:3.0:1782480883.681912:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:3.0:1782480883.681922:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:10417:x1869066366133760:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480883.681942:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480883.681961:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd5d expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.681993:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf5683 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd56 expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.682017:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480883.682021:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480883.682027:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.682062:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf5683 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd56 expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.682075:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf5683 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd56 expref: 7 pid: 6608 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480883.682091:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6609:1869066388180096:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480883.682177:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6ba23c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480883.703978:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.704464:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f0380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6609:1869066388180096:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480883.704508:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.704534:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779be00, rc 0) 00000100:00100000:3.0:1782480883.704611:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:10417:x1869066366133760:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 22688us (22809us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480883.704625:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:3.0:1782480883.704720:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366133888 00000100:00100000:3.0:1782480883.704728:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366133888 00010000:00010000:3.0:1782480883.704783:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf5683 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd56 expref: 7 pid: 6608 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480883.704817:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:3.0:1782480883.704826:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d1303050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366133888:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480883.704841:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480883.704864:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf5683 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd56 expref: 7 pid: 6608 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.704878:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf5683 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd56 expref: 7 pid: 6608 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.704901:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf5683 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd56 expref: 7 pid: 6608 timeout: 514 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.704916:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480883.704920:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480883.704928:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 6 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.704938:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 6 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.704972:0:5788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 6 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480883.705238:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5788:1869066388180224:192.168.201.58@tcp:105: 00000100:00100000:3.0:1782480883.705311:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c3ca6540 going to sleep for 11 seconds 00000100:00100000:0.0:1782480883.711772:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f0380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5788:1869066388180224:192.168.201.58@tcp:105: 00010000:00010000:0.0:1782480883.711805:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480883.711876:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d1303050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366133888:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 7050us (7906us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480883.711889:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:3.0:1782480883.719255:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480883.719408:0:6614:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366134016 00000100:00100000:1.0:1782480883.719420:0:6614:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366134016 00002000:00100000:1.0:1782480883.719477:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91d7c67f2300 x1869066366134016/t0(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:639/0 lens 504/0 e 0 to 0 dl 1782480894 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782480883.719490:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7c67f2300 with x1869066366134016 ext(0->8) 00002000:00010000:1.0:1782480883.719496:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7c67f2300 00000100:00100000:1.0:1782480883.719524:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1782480883.719534:0:6614:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366134016:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1782480883.720352:0:6614:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2351:x1869066366134016:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 814us (1101us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1782480883.720362:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00002000:00100000:1.0:1782480883.720372:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff91d7c67f2300 x1869066366134016/t4294967302(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:639/0 lens 504/448 e 0 to 0 dl 1782480894 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1782480883.720394:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7c67f2300 with x1869066366134016 ext(0->8) 00002000:00010000:1.0:1782480883.720399:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7c67f2300 00000100:00100000:2.0:1782480883.727394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.730473:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366134144 00000100:00100000:3.0:1782480883.730491:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366134144 00000100:00100000:3.0:1782480883.730581:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:3.0:1782480883.730595:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:10417:x1869066366134144:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000100:00100000:3.0:1782480883.730802:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:10417:x1869066366134144:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 209us (3429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480883.730810:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:3.0:1782480883.737790:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480883.738623:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366134272 00000100:00100000:0.0:1782480883.738642:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366134272 00000100:00100000:0.0:1782480883.738761:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:0.0:1782480883.738775:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366134272:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000001:00080000:1.0:1782480883.748479:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967355 is committed 00000004:00080000:1.0:1782480883.748550:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000004:00080000:1.0:1782480883.748581:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000004:00080000:1.0:1782480883.748616:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000020:00080000:1.0:1782480883.748626:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d7c8d1f540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1782480883.748631:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4b42d00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d7c8d1fe40 00000020:00080000:1.0:1782480883.748635:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4b42100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d7f4ed4c00 00000020:00080000:1.0:1782480883.748712:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:1.0:1782480883.748856:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1782480883.749276:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388180352:0@lo:2:osp-syn-0-0.0 00000100:00100000:3.0:1782480883.749324:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388180480:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1782480883.749384:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480883.749437:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388180352 00000100:00100000:3.0:1782480883.749452:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388180352 00000100:00100000:3.0:1782480883.749569:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782480883.749582:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388180352:12345-0@lo:2:osp-syn-0-0.0 00000100:00080000:1.0:1782480883.749586:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:3.0:1782480883.749892:0:6607:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782480883.749897:0:6607:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782480883 00002000:00010000:3.0:1782480883.749901:0:6607:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782480883.749904:0:6607:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782480883 -> 1782480883 00002000:00010000:3.0:1782480883.749906:0:6607:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:3.0:1782480883.749973:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388180352:12345-0@lo:2:osp-syn-0-0.0 Request processed in 393us (589us total) trans 4294967303 rc 0/0 00000100:00100000:3.0:1782480883.749982:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782480883.750033:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480883.750081:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388180480 00000100:00100000:3.0:1782480883.750086:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388180480 00000100:00100000:3.0:1782480883.750123:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782480883.750130:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3313:x1869066388180480:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782480883.750149:0:6609:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:3.0:1782480883.750190:0:6609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a3e7ff0, atime: 0x6a3e7ff0, ctime: 0x6a3e7ff0, blocks: 0xb 00010000:00010000:3.0:1782480883.750203:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcf4db32/0x4776e02a9acf5691 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.750226:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=414s v=(0 0) 00010000:00010000:3.0:1782480883.750231:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480883.750238:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf4db32/0x4776e02a9acf5691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.750258:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fcf4db32/0x4776e02a9acf5691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.750268:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fcf4db32/0x4776e02a9acf5691 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.750276:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fcf4db32/0x4776e02a9acf5691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.750317:0:6609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480883.750394:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480883.750405:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fcf4db32/0x4776e02a9acf5691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.750422:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782480883.750427:0:8324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcf4db32/0x4776e02a9acf5691 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.750441:0:8324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fcf4db32/0x4776e02a9acf5691 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.750466:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fcf4db32/0x4776e02a9acf5691 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.750474:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fcf4db32/0x4776e02a9acf5691 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.750517:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480883.750541:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480883.750544:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1782480883.750601:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7dfb76d80/2, rc 0, transno 4294967303 00000100:00100000:1.0:1782480883.750611:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388180352:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1782480883.750749:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782480883.751084:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3313:x1869066388180480:12345-0@lo:6:osp-syn-1-0.0 Request processed in 951us (1047us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1782480883.751094:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000004:00080000:2.0:1782480883.751349:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7c67f0380/2, rc 0, transno 4294967301 00000100:00100000:2.0:1782480883.751361:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388180480:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782480883.834715:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366134272:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 95932us (96929us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480883.834730:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000001:00080000:0.0:1782480883.834772:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000100:00100000:2.0:1782480883.840814:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480883.843590:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366134528 00000100:00100000:0.0:1782480883.843607:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366134528 00000100:00100000:0.0:1782480883.843697:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:0.0:1782480883.843708:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:10417:x1869066366134528:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782480883.843765:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480883.843795:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf567c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd4f expref: 13 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.843817:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c51d1e00) 00010000:00010000:0.0:1782480883.843823:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480883.843861:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.843880:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.843891:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480883.844177:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000773aa2b9 reply state 0000000056ff791a transno 4294967356 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480883.844187:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480883.844386:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb77480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:10417:x1869066366134528:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 677us (3581us total) trans 4294967356 rc 0/0 00000100:00100000:0.0:1782480883.844396:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00010000:00010000:3.0:1782480883.857821:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.857846:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.857856:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.857864:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480883.857870:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.857879:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.857903:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c51d1e00) 00010000:00010000:3.0:1782480883.857907:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480883.857914:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.857921:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5698 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480883.859558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.867526:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366134656 00000100:00100000:3.0:1782480883.867552:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366134656 00000100:00100000:3.0:1782480883.867813:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:3.0:1782480883.867829:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366134656:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1782480883.868577:0:8498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:3.0:1782480883.868585:0:8498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1782480883 -> 1782480882 00002000:00010000:3.0:1782480883.868588:0:8498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782480880 00002000:00010000:3.0:1782480883.868609:0:8498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782480883 -> 1782480882 00002000:00010000:3.0:1782480883.868612:0:8498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1782480883.868775:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366134656:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 945us (9224us total) trans 4294967304 rc 0/0 00000100:00100000:3.0:1782480883.868787:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:1.0:1782480883.875496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480883.875611:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366134912 00000100:00100000:2.0:1782480883.875631:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366134912 00000100:00100000:2.0:1782480883.875723:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:2.0:1782480883.875738:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:10417:x1869066366134912:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1782480883.875823:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.875842:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd41 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.875852:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.875895:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd41 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.875911:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd41 expref: 13 pid: 5804 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480883.875927:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfb75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388180608:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480883.876087:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480883.885526:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480883.886430:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfb75c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388180608:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480883.886461:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480883.886630:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366135040 00000100:00100000:3.0:1782480883.886646:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366135040 00010000:00010000:3.0:1782480883.886769:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd41 expref: 14 pid: 5804 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480883.886824:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:3.0:1782480883.886837:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:2350:x1869066366135040:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480883.886858:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480883.886866:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd41 expref: 14 pid: 5804 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.886881:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd41 expref: 14 pid: 5804 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.886915:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5659 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd41 expref: 14 pid: 5804 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.886939:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c51d1e00) 00010000:00010000:3.0:1782480883.886947:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.886960:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.886999:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.887037:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480883.887150:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ff800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:2350:x1869066366135040:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 314us (1632us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480883.887160:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00010000:00010000:0.0:1782480883.887216:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.887253:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.887304:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.887311:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.887319:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.887326:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2c600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480883.887330:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.887338:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.887357:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c51d1e00) 00010000:00010000:0.0:1782480883.887360:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1782480883.887366:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.887371:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf569f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480883.887461:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:10417:x1869066366134912:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 11726us (11976us total) trans 0 rc -22/-22 00000100:00100000:0.0:1782480883.887470:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:2.0:1782480883.907807:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.908014:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366135168 00000100:00100000:3.0:1782480883.908046:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366135168 00000100:00100000:3.0:1782480883.908141:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:3.0:1782480883.908156:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366135168:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1782480883.908232:0:6607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.908262:0:6607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.908274:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480883.908279:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782480883.908285:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.908354:0:6607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 7 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.908373:0:6607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 7 pid: 6609 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480883.908417:0:6607:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6607:1869066388180736:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480883.908556:0:6607:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dc806600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480883.918589:0:6607:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6607:1869066388180736:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480883.918637:0:6607:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480883.925746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480883.926210:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366135296 00000100:00100000:0.0:1782480883.926228:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366135296 00010000:00010000:0.0:1782480883.926287:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 8 pid: 6609 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480883.926383:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:0.0:1782480883.926404:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366135296:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480883.926426:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480883.926450:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 8 pid: 6609 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.926464:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 8 pid: 6609 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.926489:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a595bb00/0x4776e02a9acf568a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd5d expref: 8 pid: 6609 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.926508:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480883.926513:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480883.926518:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.926529:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480883.926573:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480883.926648:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366135296:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 255us (918us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480883.926715:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00010000:00010000:1.0:1782480883.926868:0:6607:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.926879:0:6607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.926909:0:6607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.926926:0:6607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.926934:0:6607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.926941:0:6607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782480883.926947:0:6607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.926956:0:6607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.926969:0:6607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480883.926977:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf56a6 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480883.927048:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366135168:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 18897us (19263us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480883.927068:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:1.0:1782480883.944944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480883.945394:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366135552 00000100:00100000:3.0:1782480883.945410:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366135552 00000100:00100000:3.0:1782480883.945503:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:3.0:1782480883.945519:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:10417:x1869066366135552:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782480883.945650:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf56ad lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.945731:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf56ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.945751:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf56ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.946253:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.946279:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5667 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd48 expref: 13 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.946364:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.946480:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd48 expref: 13 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.946500:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5667 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd48 expref: 13 pid: 6840 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480883.946516:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfb74380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388180864:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480883.946640:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057cd80 going to sleep for 11 seconds 00000100:00100000:3.0:1782480883.954888:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfb74380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388180864:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480883.954935:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480883.974540:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480883.974745:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366135680 00000100:00100000:2.0:1782480883.974773:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366135680 00010000:00010000:2.0:1782480883.974849:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5667 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd48 expref: 14 pid: 6840 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480883.974912:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1782480883.974946:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:2350:x1869066366135680:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480883.974971:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480883.974980:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5667 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd48 expref: 14 pid: 6840 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.974998:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5667 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd48 expref: 14 pid: 6840 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.975033:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf5667 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd48 expref: 14 pid: 6840 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.975066:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c51d1e00) 00010000:00010000:2.0:1782480883.975072:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.975085:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.975105:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480883.975147:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480883.975232:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:2350:x1869066366135680:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 289us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480883.975241:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00010000:00010000:3.0:1782480883.989486:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480883.989547:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480883.989937:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1782480883.990133:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000001:00080000:3.0:1782480883.990431:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:3.0:1782480883.990578:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5802:1869066388180992:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1782480883.992340:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480883.992600:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388180992 00000100:00100000:0.0:1782480883.992616:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388180992 00000100:00100000:0.0:1782480883.992724:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480883.992738:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5802:x1869066388180992:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782480883.992882:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5802:x1869066388180992:12345-0@lo:1000:mdt00_000.0 Request processed in 148us (555us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480883.992891:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782480883.992922:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8a11b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782480883.992965:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5802:1869066388180992:0@lo:1000:mdt00_000.0 00000001:00080000:0.0:1782480883.993727:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967360 00000100:00100000:0.0:1782480883.993847:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5802:1869066388181120:0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1782480883.993911:0:5802:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480883.993951:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6ba23c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480883.994401:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388181120 00000100:00100000:2.0:1782480883.994411:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388181120 00000100:00100000:2.0:1782480883.994457:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1782480883.994467:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5802:x1869066388181120:12345-0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1782480883.994774:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5802:x1869066388181120:12345-0@lo:1000:mdt00_000.0 Request processed in 306us (861us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1782480883.994782:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480884.000444:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5802:1869066388181120:0@lo:1000:mdt00_000.0 00010000:00010000:0.0:1782480884.000523:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000538:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000548:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000556:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2c600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480884.000562:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000606:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000632:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c51d1e00) 00010000:00010000:0.0:1782480884.000636:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480884.000643:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000650:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf56b4 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000775:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55e2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000783:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55e2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000790:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000796:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480884.000799:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55e2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000806:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55e2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000816:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480884.000819:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480884.000823:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55e2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000841:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf55e2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000878:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000897:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd2c expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000908:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000969:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd2c expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.000988:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd2c expref: 16 pid: 5802 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480884.001008:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ece68000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388181248:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480884.001438:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6ba23c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480884.005993:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ece68000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388181248:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480884.006987:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480884.015079:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480884.017117:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366135808 00000100:00100000:2.0:1782480884.017145:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366135808 00010000:00010000:2.0:1782480884.017228:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd2c expref: 17 pid: 5802 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480884.017315:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:2.0:1782480884.017329:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+17:2351:x1869066366135808:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480884.017353:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480884.017360:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd2c expref: 17 pid: 5802 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.017377:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd2c expref: 17 pid: 5802 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.017409:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf55fe lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd2c expref: 17 pid: 5802 timeout: 514 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.017434:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:2.0:1782480884.017440:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.017453:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.017462:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.017536:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480884.017645:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed018a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:2351:x1869066366135808:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 318us (2583us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480884.017654:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00010000:00010000:0.0:1782480884.018535:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018556:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018589:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018597:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018606:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018615:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480884.018622:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018631:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018650:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480884.018654:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480884.018690:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018707:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf56bb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018732:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf56ad lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018739:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf56ad lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018746:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf56ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018769:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480884.018773:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf56ad lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018778:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf56ad lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018788:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480884.018790:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782480884.018793:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf56ad lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480884.018799:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf56ad lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480884.019144:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:10417:x1869066366135552:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 73622us (74210us total) trans 4294967361 rc 0/0 00000100:00100000:0.0:1782480884.019155:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00000020:00080000:0.0:1782480884.019161:0:5802:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1782480884.019601:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782480884.019610:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480884.019639:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1782480884.019647:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480884.035855:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480884.036654:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366136064 00000100:00100000:2.0:1782480884.036724:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366136064 00000100:00100000:2.0:1782480884.036822:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:2.0:1782480884.036835:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:10417:x1869066366136064:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782480884.043043:0:5805:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782480884.043191:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967362 00010000:00010000:2.0:1782480884.043316:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.043338:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.043353:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.043365:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.043372:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.043378:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480884.043401:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782480884.043570:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+17:10417:x1869066366136064:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 6730us (7725us total) trans 4294967363 rc 0/0 00000100:00100000:2.0:1782480884.043583:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000020:00080000:2.0:1782480884.043592:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782480884.043721:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480884.043732:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480884.043741:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782480884.043746:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480884.043755:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480884.043774:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff91d7c610b300) 00010000:00010000:3.0:1782480884.043777:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782480884.043783:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480884.043789:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf56c2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480884.043826:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480884.043827:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480884.043829:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480884.127275:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfa79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388181376:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480884.127415:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480884.127676:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388181376 00000100:00100000:2.0:1782480884.127688:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388181376 00000100:00100000:2.0:1782480884.129056:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1782480884.129097:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fefbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1869066388181376:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480884.129138:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:2.0:1782480884.135876:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fefbe450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1869066388181376:12345-0@lo:13:osp-pre-0-0.0 Request processed in 6787us (8445us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480884.135896:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782480884.137801:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfa79880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388181376:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480884.202944:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480884.203015:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480884.203363:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366136320 00000100:00100000:0.0:1782480884.203363:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366136192 00000100:00100000:0.0:1782480884.203378:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366136192 00000100:00100000:2.0:1782480884.203385:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366136320 00000100:00100000:2.0:1782480884.203450:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:2.0:1782480884.203463:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366136320:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480884.203502:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 295 00000100:00100000:0.0:1782480884.203509:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366136192:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:1.0:1782480884.203566:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480884.204411:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366136320:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 939us (1471us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480884.204423:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:0.0:1782480884.218924:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366136192:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 15392us (15886us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480884.218949:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 295 00000100:00100000:2.0:1782480884.221444:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480884.221642:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366136448 00000100:00100000:3.0:1782480884.221678:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366136448 00000100:00100000:3.0:1782480884.221771:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 154 00000100:00100000:3.0:1782480884.221784:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366136448:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480884.221903:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb76300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366136448:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 121us (540us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480884.221912:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 154 00000100:00080000:1.0:1782480884.221989:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782480884.702812:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1782480885.243792:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000001:00080000:0.0:1782480885.243822:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000040:00080000:2.0:1782480885.473135:0:11933:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782480885.473150:0:11933:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782480885.473208:0:11933:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1782480885.473214:0:11933:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1782480885.726837:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480885.754444:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480885.754575:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366136704 00000100:00100000:2.0:1782480885.754589:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366136704 00000100:00080000:1.0:1782480885.754673:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480885.754713:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:2.0:1782480885.754728:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+17:10436:x1869066366136704:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1782480885.754783:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480885.754812:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf56c9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd64 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480885.755419:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf56d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480885.755441:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf56d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480885.755456:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf56d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480885.755471:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:2.0:1782480885.755772:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf56c9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd64 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480885.755797:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf56d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd64 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480885.755810:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:2.0:1782480885.755813:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1782480885.755817:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d600, rc 0) 00000100:00100000:2.0:1782480885.755944:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:10436:x1869066366136704:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1210us (1504us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1782480885.755954:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:2.0:1782480885.762213:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480885.762318:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366136832 00000100:00100000:3.0:1782480885.762332:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366136832 00000100:00100000:3.0:1782480885.762409:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:3.0:1782480885.762421:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:10436:x1869066366136832:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1782480885.762536:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf56de lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.762558:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf56de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.762573:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf56de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.762590:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.762611:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.762619:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763049:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763060:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763069:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480885.763134:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763151:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf56de lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763158:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf56de lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763166:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf56de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763173:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480885.763179:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf56de lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763187:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf56de lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763209:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480885.763213:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480885.763220:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf56de lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763226:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf56de lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763239:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763245:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56e5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763251:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763256:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480885.763270:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763276:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56e5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763283:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1500) 00010000:00010000:3.0:1782480885.763286:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480885.763289:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56e5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763294:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763325:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763331:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763337:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763342:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480885.763345:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763352:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763360:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1300) 00010000:00010000:3.0:1782480885.763363:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480885.763365:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.763371:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480885.763492:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:10436:x1869066366136832:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 1069us (1291us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480885.763502:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:1.0:1782480885.876491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480885.876647:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366137088 00000100:00100000:3.0:1782480885.876687:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366137088 00000100:00100000:3.0:1782480885.876764:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:3.0:1782480885.876794:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:10439:x1869066366137088:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480885.876826:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480885.876861:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd6b expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.876967:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56fa lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.876989:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877003:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877021:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5701 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877028:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877037:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877485:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877495:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877503:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480885.877527:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1782480885.877695:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56fa lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877705:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56fa lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877714:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877722:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480885.877729:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56fa lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877739:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56fa lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877757:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480885.877761:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480885.877766:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56fa lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877774:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf56fa lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877790:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5701 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877797:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5701 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877816:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877821:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480885.877824:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5701 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877831:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5701 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877839:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1300) 00010000:00010000:3.0:1782480885.877842:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480885.877845:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5701 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877851:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5701 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877915:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf56f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd6b expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877929:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd6b expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.877936:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:3.0:1782480885.877939:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480885.877941:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779bc00, rc 0) 00000100:00100000:3.0:1782480885.878045:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:10439:x1869066366137088:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1253us (1568us total) trans 4294967365 rc 0/0 00000100:00100000:3.0:1782480885.878063:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:1.0:1782480885.889839:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480885.889922:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366137216 00000100:00100000:3.0:1782480885.889937:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366137216 00000100:00100000:3.0:1782480885.890025:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:3.0:1782480885.890037:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:10439:x1869066366137216:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1782480885.890141:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5716 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.890165:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.890180:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.890214:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5716 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.890222:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5716 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.890230:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.890237:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480885.890242:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5716 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.890250:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5716 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.890273:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:3.0:1782480885.890294:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480885.890300:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5716 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.890308:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5716 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480885.890404:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:10439:x1869066366137216:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 368us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480885.890412:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:3.0:1782480885.896916:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480885.897807:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366137472 00000100:00100000:1.0:1782480885.897824:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366137472 00000100:00100000:1.0:1782480885.897916:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1782480885.897928:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:10439:x1869066366137472:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1782480885.898333:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b67450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:10439:x1869066366137472:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 404us (1431us total) trans 4294967366 rc 0/0 00000100:00100000:1.0:1782480885.898345:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1782480885.983140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480885.983477:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366137728 00000100:00100000:2.0:1782480885.983491:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366137728 00000100:00100000:2.0:1782480885.983584:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:2.0:1782480885.983596:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:9959:x1869066366137728:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1782480885.983631:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480885.983687:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf571d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd72 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480885.983832:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480885.983854:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd6b expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480885.983865:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480885.983911:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd6b expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480885.983928:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd6b expref: 23 pid: 5803 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480885.983946:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfb77800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388181504:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480885.987410:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df4956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480885.996798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480885.996837:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366137856 00000100:00100000:3.0:1782480885.996850:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366137856 00010000:00010000:3.0:1782480885.996944:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd6b expref: 24 pid: 5803 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480885.996989:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:3.0:1782480885.997001:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:2350:x1869066366137856:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480885.997019:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480885.997027:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd6b expref: 24 pid: 5803 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.997043:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd6b expref: 24 pid: 5803 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.997085:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:3.0:1782480885.997091:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.997121:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.997130:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.997156:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480885.997226:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:2350:x1869066366137856:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 226us (438us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480885.997235:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00010000:00010000:3.0:1782480885.997550:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5708 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd6b expref: 23 pid: 5803 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480885.997570:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfb77800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388181504:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480885.997595:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.997606:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.997612:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480885.997638:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:3.0:1782480885.997899:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf571d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd72 expref: 24 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.997917:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd72 expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480885.997939:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:3.0:1782480885.997943:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782480885.997946:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2ca00, rc 0) 00000100:00100000:3.0:1782480885.997992:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:9959:x1869066366137728:12345-192.168.201.58@tcp:101:bash.0 Request processed in 14398us (14868us total) trans 4294967367 rc 0/0 00000100:00100000:3.0:1782480885.998000:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:3.0:1782480885.999970:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480886.000148:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366138112 00000100:00100000:2.0:1782480886.000164:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366138112 00000100:00100000:2.0:1782480886.000471:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 89 00000100:00100000:2.0:1782480886.000485:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:9959:x1869066366138112:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:2.0:1782480886.000949:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.000987:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.001001:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782480886.001061:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000004:00010000:2.0:1782480886.001085:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000003673a778 reply state 00000000b20a8188 transno 4294967369 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480886.001096:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1782480886.001186:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967369 00000100:00100000:2.0:1782480886.001325:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:9959:x1869066366138112:12345-192.168.201.58@tcp:36:bash.0 Request processed in 842us (1370us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1782480886.001334:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 89 00000020:00080000:2.0:1782480886.001339:0:6840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:1.0:1782480886.014577:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:0.0:1782480886.014697:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.014716:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.014724:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.014731:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480886.014737:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.014746:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.014771:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:0.0:1782480886.014774:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480886.014780:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.014787:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5732 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480886.017062:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366138240 00000100:00100000:3.0:1782480886.017087:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366138240 00000100:00100000:3.0:1782480886.017268:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:3.0:1782480886.017282:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:9959:x1869066366138240:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1782480886.017320:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480886.017350:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5739 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd79 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.017434:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5739 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd79 expref: 27 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.017451:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5739 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd79 expref: 27 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.017475:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:3.0:1782480886.017479:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480886.017484:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ba00, rc 0) 00000100:00100000:3.0:1782480886.017589:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:9959:x1869066366138240:12345-192.168.201.58@tcp:101:bash.0 Request processed in 310us (3028us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480886.017621:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:3.0:1782480886.025011:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480886.025127:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366138368 00000100:00100000:0.0:1782480886.025139:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366138368 00000100:00100000:0.0:1782480886.025235:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:0.0:1782480886.025249:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:9959:x1869066366138368:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1782480886.025285:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480886.025339:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5740 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd80 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480886.025380:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3e7ff2, atime: 0x6a3e7ff0, ctime: 0x6a3e7ff2, blocks: 0xb 00010000:00010000:0.0:1782480886.025410:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=416s v=(0 0) 00010000:00010000:0.0:1782480886.025416:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480886.025427:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd80 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.025450:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd80 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.025466:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b800, rc 0) 00000100:00100000:0.0:1782480886.025545:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:9959:x1869066366138368:12345-192.168.201.58@tcp:101:bash.0 Request processed in 300us (551us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480886.025553:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00080000:2.0:1782480886.025795:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480886.028357:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480886.028447:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366138496 00000100:00100000:0.0:1782480886.028461:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366138496 00002000:00010000:0.0:1782480886.028516:0:6612:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1782480886.028523:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7dfa7bb80 with x1869066366138496 ext(0->18446744073709551615) 00002000:00010000:0.0:1782480886.028539:0:6612:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7dfa7bb80. 00000100:00100000:0.0:1782480886.028574:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1782480886.028584:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2352:x1869066366138496:12345-192.168.201.58@tcp:10:bash.0 00002000:00010000:0.0:1782480886.029024:0:6612:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1782480886.029029:0:6612:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 1782480882 -> 1782480886 00002000:00010000:0.0:1782480886.029032:0:6612:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 1782480880 -> 1782480880 00002000:00010000:0.0:1782480886.029053:0:6612:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 1782480882 -> 1782480886 00002000:00010000:0.0:1782480886.029056:0:6612:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1782480886.029280:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2352:x1869066366138496:12345-192.168.201.58@tcp:10:bash.0 Request processed in 692us (933us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1782480886.029290:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00002000:00010000:0.0:1782480886.029295:0:6612:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/3 (0->18446744073709551615) 00002000:00100000:0.0:1782480886.029298:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7dfa7bb80 with x1869066366138496 ext(0->18446744073709551615) 00002000:00010000:0.0:1782480886.029305:0:6612:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7dfa7bb80. 00000100:00100000:0.0:1782480886.095828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480886.095954:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366138624 00000100:00100000:2.0:1782480886.095970:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366138624 00000100:00100000:2.0:1782480886.096045:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:2.0:1782480886.096068:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:10453:x1869066366138624:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:2.0:1782480886.096174:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5747 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096200:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5747 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096215:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5747 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096267:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf574e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096276:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf574e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096283:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf574e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096711:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096722:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096730:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480886.096782:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096797:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5747 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096803:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5747 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096812:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5747 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096818:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2de00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480886.096823:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5747 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096837:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5747 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096854:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:2.0:1782480886.096857:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480886.096863:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5747 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096869:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5747 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096884:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf574e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096890:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf574e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096898:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf574e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096902:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2dc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480886.096906:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf574e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096911:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf574e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096917:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c610b800) 00010000:00010000:2.0:1782480886.096920:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480886.096922:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf574e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096937:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf574e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096954:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096960:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096966:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096971:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2da00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480886.096975:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096981:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.096989:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:2.0:1782480886.096991:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480886.096994:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.097000:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5755 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480886.097098:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:10453:x1869066366138624:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 1028us (1281us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480886.097108:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:0.0:1782480886.133654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.133864:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366138880 00000100:00100000:3.0:1782480886.133878:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366138880 00000100:00100000:3.0:1782480886.133958:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:3.0:1782480886.133971:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:10456:x1869066366138880:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480886.134001:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480886.134031:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf575c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd87 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134153:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5763 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134171:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5763 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134184:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5763 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134200:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf576a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134208:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf576a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134215:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf576a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134738:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5771 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134765:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134775:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5771 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480886.134791:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:3.0:1782480886.134940:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5763 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134948:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5763 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134956:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5763 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134963:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480886.134968:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5763 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134977:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5763 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.134994:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480886.134998:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480886.135003:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5763 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135009:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5763 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135026:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf576a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135039:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf576a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135045:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf576a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135050:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480886.135053:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf576a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135058:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf576a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135067:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1300) 00010000:00010000:3.0:1782480886.135069:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480886.135072:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf576a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135078:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf576a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135142:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf575c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd87 expref: 30 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135157:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5771 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd87 expref: 29 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.135165:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:3.0:1782480886.135168:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782480886.135177:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b800, rc 0) 00000100:00100000:3.0:1782480886.135289:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:10456:x1869066366138880:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1320us (1650us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1782480886.135299:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 92 00000100:00100000:1.0:1782480886.138832:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.139033:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366139008 00000100:00100000:3.0:1782480886.139047:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366139008 00000100:00100000:3.0:1782480886.139140:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:3.0:1782480886.139152:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:10456:x1869066366139008:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1782480886.139249:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.139283:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd72 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.139294:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.139343:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd72 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.139360:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd72 expref: 29 pid: 5803 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480886.139380:0:6840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1869066388181632:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480886.139572:0:6840:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c780 going to sleep for 11 seconds 00000100:00100000:1.0:1782480886.143406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480886.143858:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366139264 00000100:00100000:0.0:1782480886.143872:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366139264 00000100:00100000:0.0:1782480886.143953:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:0.0:1782480886.143964:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:5567:x1869066366139264:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1782480886.144645:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:5567:x1869066366139264:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 677us (1254us total) trans 4294967372 rc 0/0 00000100:00100000:0.0:1782480886.144657:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:3.0:1782480886.145349:0:6840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1869066388181632:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480886.145400:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480886.148955:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.149340:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366139392 00000100:00100000:3.0:1782480886.149354:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366139392 00010000:00010000:3.0:1782480886.149412:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd72 expref: 31 pid: 5803 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480886.149465:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:3.0:1782480886.149477:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:2350:x1869066366139392:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480886.149498:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480886.149506:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd72 expref: 31 pid: 5803 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.149523:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd72 expref: 31 pid: 5803 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.149556:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5724 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd72 expref: 31 pid: 5803 timeout: 516 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.149578:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:3.0:1782480886.149584:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.149596:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.149605:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.149645:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480886.149808:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece68700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:2350:x1869066366139392:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 331us (868us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480886.149818:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00010000:00010000:2.0:1782480886.149897:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.149907:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.149950:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.149958:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.149965:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.149971:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480886.149976:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.149985:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.149996:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:2.0:1782480886.150009:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480886.150014:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.150019:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf577f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480886.150077:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:10456:x1869066366139008:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 10928us (11262us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480886.150086:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:1.0:1782480886.157909:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480886.158047:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366139648 00000100:00100000:0.0:1782480886.158076:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366139648 00000100:00100000:0.0:1782480886.158336:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:0.0:1782480886.158350:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:10456:x1869066366139648:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1782480886.158720:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:10456:x1869066366139648:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 370us (826us total) trans 4294967373 rc 0/0 00000100:00100000:0.0:1782480886.158729:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:1.0:1782480886.269235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.269394:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366139904 00000100:00100000:3.0:1782480886.269407:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366139904 00000100:00100000:3.0:1782480886.269491:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:3.0:1782480886.269503:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:10467:x1869066366139904:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:3.0:1782480886.269539:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480886.269568:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5786 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd8e expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.269702:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf578d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.269722:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf578d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.269736:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf578d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.269752:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5794 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.269759:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.269765:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270197:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf579b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270222:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf579b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270230:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf579b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480886.270243:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1782480886.270389:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf578d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270396:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf578d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270403:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf578d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270409:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480886.270415:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf578d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270422:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf578d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270436:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480886.270439:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480886.270444:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf578d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270450:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf578d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270465:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5794 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270478:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5794 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270484:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270488:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480886.270491:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5794 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270498:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5794 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270505:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1300) 00010000:00010000:3.0:1782480886.270508:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480886.270510:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5794 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270515:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5794 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270573:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5786 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd8e expref: 33 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270588:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf579b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd8e expref: 32 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.270595:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:3.0:1782480886.270597:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480886.270605:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ac00, rc 0) 00000100:00100000:3.0:1782480886.270755:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:10467:x1869066366139904:12345-192.168.201.58@tcp:101:cat.0 Request processed in 1252us (1534us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1782480886.270764:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:1.0:1782480886.283314:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480886.283433:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366140160 00000100:00100000:0.0:1782480886.283467:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366140160 00000100:00100000:0.0:1782480886.283598:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:0.0:1782480886.283609:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:10467:x1869066366140160:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:0.0:1782480886.283971:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:10467:x1869066366140160:12345-192.168.201.58@tcp:35:cat.0 Request processed in 363us (874us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1782480886.283980:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:1.0:1782480886.309193:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.311473:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366140416 00000100:00100000:3.0:1782480886.311494:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366140416 00000100:00100000:3.0:1782480886.311853:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:3.0:1782480886.311866:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:10468:x1869066366140416:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:3.0:1782480886.311954:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1782480886.311994:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf579b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd8e expref: 33 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312034:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5771 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd87 expref: 32 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312048:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5739 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd79 expref: 31 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312287:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1500) 00010000:00010000:3.0:1782480886.312306:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480886.312334:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf57a9 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312351:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf57a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312363:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf57a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312405:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312413:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312421:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312858:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf57b7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312869:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf57b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.312877:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf57b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480886.317468:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8472 00000004:00080000:2.0:1782480886.317491:0:5804:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 416878831119ns, next at 417878824916ns, rc = 0 00010000:00010000:2.0:1782480886.317618:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.317642:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.317928:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.317944:0:5804:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.317952:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.317959:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318257:0:5804:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782480886.318295:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf57b7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318303:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf57b7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318310:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf57b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318317:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480886.318322:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf57b7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318353:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf57b7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318371:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1100) 00010000:00010000:2.0:1782480886.318375:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1782480886.318381:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf57b7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318387:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf57b7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318412:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf57a9 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318418:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf57a9 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318423:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf57a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318428:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779bc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480886.318430:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf57a9 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318435:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf57a9 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318442:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:2.0:1782480886.318444:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480886.318449:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf57a9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.318464:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf57a9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480886.318475:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000f7cd8641 reply state 00000000a402f73d transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480886.318486:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480886.318619:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:10468:x1869066366140416:12345-192.168.201.58@tcp:36:rm.0 Request processed in 6749us (9434us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1782480886.318628:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 95 00010000:00010000:3.0:1782480886.329542:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480886.329566:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.329582:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2da00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782480886.329587:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.329599:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.329627:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff91d7c51d1100) 00010000:00010000:3.0:1782480886.329630:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1782480886.329803:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.329812:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf57be lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.329912:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480886.329915:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480886.329917:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480886.330295:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.330308:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.330317:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.330323:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480886.330329:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.330336:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.330349:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1300) 00010000:00010000:3.0:1782480886.330352:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480886.330356:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.330363:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57b0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480886.368534:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.368820:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366140672 00000100:00100000:3.0:1782480886.368835:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366140672 00000100:00100000:3.0:1782480886.368920:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:3.0:1782480886.368933:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:10474:x1869066366140672:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1782480886.368971:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480886.369257:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57c5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd95 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.369475:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf57cc lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.369495:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf57cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.369509:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf57cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.369526:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.369533:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.369539:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782480886.371332:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1782480886.371625:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.371646:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.371862:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.371917:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf57cc lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.371926:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf57cc lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.371934:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf57cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.371941:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480886.371960:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf57cc lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.371972:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf57cc lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.372159:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:2.0:1782480886.372164:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480886.372170:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf57cc lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.372178:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf57cc lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480886.372197:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000cf4c831c reply state 00000000f837cef5 transno 4294967377 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480886.372208:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782480886.372273:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf57c5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd95 expref: 34 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.372291:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd95 expref: 33 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.372300:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c610b800) 00010000:00010000:2.0:1782480886.372302:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480886.372305:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2dc00, rc 0) 00000100:00100000:2.0:1782480886.372497:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:10474:x1869066366140672:12345-192.168.201.58@tcp:101:bash.0 Request processed in 3565us (3976us total) trans 4294967377 rc 0/0 00000100:00100000:2.0:1782480886.372508:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:1.0:1782480886.378287:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:0.0:1782480886.378835:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.378850:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.378859:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.378865:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480886.378873:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.378882:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.378908:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1300) 00010000:00010000:0.0:1782480886.378912:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480886.378919:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.378926:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf57d3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480886.379087:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366140800 00000100:00100000:2.0:1782480886.379163:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366140800 00000100:00100000:2.0:1782480886.379329:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:2.0:1782480886.379341:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366140800:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1782480886.379369:0:8498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480886.379395:0:8498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004244c172/0x4776e02a9acf57e8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fd9c expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480886.379431:0:8498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480886.379456:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=416s v=(0 0) 00010000:00010000:2.0:1782480886.379461:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480886.379472:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004244c172/0x4776e02a9acf57e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd9c expref: 6 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.379492:0:8498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004244c172/0x4776e02a9acf57e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd9c expref: 6 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.379507:0:8498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2de00, rc 0) 00000100:00100000:2.0:1782480886.379602:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366140800:12345-192.168.201.58@tcp:101:bash.0 Request processed in 262us (1331us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480886.379610:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00080000:1.0:1782480886.383377:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782480886.383804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480886.383900:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366140928 00000100:00100000:0.0:1782480886.383922:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366140928 00000100:00100000:0.0:1782480886.384053:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1782480886.384066:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:10474:x1869066366140928:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1782480886.384101:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480886.384129:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fda3 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.384176:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004244c172/0x4776e02a9acf57e8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd9c expref: 7 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.384187:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480886.384191:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480886.384197:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.384245:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004244c172/0x4776e02a9acf57e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd9c expref: 7 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.384272:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004244c172/0x4776e02a9acf57e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd9c expref: 7 pid: 8498 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480886.384290:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ece69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1869066388181760:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480886.384416:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dc806600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480886.389386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.389705:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ece69c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1869066388181760:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480886.389755:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 7 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.389813:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297be00, rc 0) 00000100:00100000:2.0:1782480886.390005:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:10474:x1869066366140928:12345-192.168.201.58@tcp:101:bash.0 Request processed in 5932us (6200us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480886.390017:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:1.0:1782480886.391934:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366141056 00000100:00100000:1.0:1782480886.391957:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366141056 00010000:00010000:1.0:1782480886.392198:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004244c172/0x4776e02a9acf57e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd9c expref: 7 pid: 8498 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480886.392316:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:1.0:1782480886.392328:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d1302c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366141056:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480886.392351:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480886.392381:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004244c172/0x4776e02a9acf57e8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd9c expref: 7 pid: 8498 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.392398:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004244c172/0x4776e02a9acf57e8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd9c expref: 7 pid: 8498 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.392426:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004244c172/0x4776e02a9acf57e8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd9c expref: 7 pid: 8498 timeout: 516 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.392447:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480886.392452:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480886.392462:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.392474:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.392527:0:5786:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480886.392561:0:5786:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfa79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5786:1869066388181888:192.168.201.58@tcp:105: 00000100:00100000:1.0:1782480886.392725:0:5786:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96180 going to sleep for 11 seconds 00000100:00100000:0.0:1782480886.397311:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480886.397613:0:5786:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfa79c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5786:1869066388181888:192.168.201.58@tcp:105: 00010000:00010000:1.0:1782480886.397646:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480886.397763:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d1302c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366141056:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 5435us (8392us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480886.397780:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:3.0:1782480886.397987:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366141312 00000100:00100000:3.0:1782480886.398009:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366141312 00000100:00100000:3.0:1782480886.398071:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:3.0:1782480886.398081:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:10474:x1869066366141312:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:3.0:1782480886.398558:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:10474:x1869066366141312:12345-192.168.201.58@tcp:35:bash.0 Request processed in 477us (1263us total) trans 4294967378 rc 0/0 00000100:00100000:3.0:1782480886.398566:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:2.0:1782480886.648590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480886.648746:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366141440 00000100:00100000:0.0:1782480886.648777:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366141440 00000100:00100000:0.0:1782480886.648861:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:0.0:1782480886.648874:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:10490:x1869066366141440:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480886.648909:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480886.648939:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf57f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fdaa expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.649026:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf57fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.649046:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf57fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.649064:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf57fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480886.649156:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:0.0:1782480886.649160:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480886.649189:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf57fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.649235:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf57f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdaa expref: 36 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.649275:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf57fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdaa expref: 35 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.649285:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:0.0:1782480886.649289:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480886.649295:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b600, rc 0) 00000100:00100000:0.0:1782480886.649400:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:10490:x1869066366141440:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 528us (825us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480886.649409:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:0.0:1782480886.658767:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.659106:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366141696 00000100:00100000:3.0:1782480886.659116:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366141696 00000100:00100000:3.0:1782480886.659412:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:3.0:1782480886.659423:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:10490:x1869066366141696:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480886.659445:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480886.659467:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5804 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fdb1 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.659593:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf580b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.659607:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf580b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.659620:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf580b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480886.659633:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782480886.659800:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5804 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdb1 expref: 38 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.659821:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf580b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdb1 expref: 37 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.659830:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c610b800) 00010000:00010000:3.0:1782480886.659834:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480886.659837:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b400, rc 0) 00000100:00100000:3.0:1782480886.659906:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:10490:x1869066366141696:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 485us (1150us total) trans 4294967379 rc 0/0 00000100:00100000:3.0:1782480886.659914:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:0.0:1782480886.664912:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480886.665829:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366141952 00000100:00100000:2.0:1782480886.665853:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366141952 00000100:00100000:2.0:1782480886.665912:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:2.0:1782480886.665923:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:10490:x1869066366141952:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1782480886.665952:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480886.665978:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5819 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fdb8 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.666254:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5820 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.666324:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5820 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.666336:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5820 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480886.666349:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00000100:00100000:0.0:1782480886.668794:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.668899:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366142080 00000100:00100000:3.0:1782480886.668909:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366142080 00000100:00100000:3.0:1782480886.668970:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:3.0:1782480886.668982:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+39:2351:x1869066366142080:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480886.669012:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480886.669040:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf580b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdb1 expref: 39 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.669063:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c610b800) 00010000:00010000:3.0:1782480886.669068:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480886.669329:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006aed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:2351:x1869066366142080:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 348us (545us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480886.669340:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00010000:00010000:2.0:1782480886.671932:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5819 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdb8 expref: 39 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.671967:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5820 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdb8 expref: 38 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.671977:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c610b800) 00010000:00010000:2.0:1782480886.671980:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1782480886.671984:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d200, rc 0) 00000100:00100000:2.0:1782480886.672188:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:10490:x1869066366141952:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 6266us (7285us total) trans 4294967380 rc 0/0 00000100:00100000:2.0:1782480886.672198:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:0.0:1782480886.687138:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388182400:0@lo:400:kworker.0 00000100:00100000:0.0:1782480886.687225:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480886.687430:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782480886.687438:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388182016:0@lo:400:kworker.0 00000100:00100000:0.0:1782480886.687471:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480886.687492:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388182528:0@lo:400:kworker.0 00000100:00100000:0.0:1782480886.687515:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480886.687703:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388182272:0@lo:400:kworker.0 00000100:00100000:2.0:1782480886.687734:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480886.687758:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1782480886.687764:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388182144:0@lo:400:kworker.0 00000100:00100000:2.0:1782480886.687783:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480886.687797:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388182656:0@lo:400:kworker.0 00000100:00100000:2.0:1782480886.687814:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480886.687843:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388182016 00000100:00100000:2.0:1782480886.687851:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388182016 00000100:00100000:2.0:1782480886.687897:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1782480886.687907:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388182016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480886.687961:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388182016:12345-0@lo:400:kworker.0 Request processed in 55us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480886.687969:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 296 00000100:00100000:2.0:1782480886.688006:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388182400 00000100:00100000:2.0:1782480886.688010:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388182400 00000100:00100000:3.0:1782480886.688047:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388182656 00000100:00100000:3.0:1782480886.688053:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388182656 00000100:00100000:0.0:1782480886.688130:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388182528 00000100:00100000:0.0:1782480886.688134:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388182528 00000100:00100000:2.0:1782480886.688187:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782480886.688194:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1869066388182400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480886.688231:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1869066388182400:12345-0@lo:400:kworker.0 Request processed in 38us (1007us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480886.688238:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782480886.688402:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388182016:0@lo:400:kworker.0 00000100:00100000:2.0:1782480886.688417:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388182400:0@lo:400:kworker.0 00000100:00100000:2.0:1782480886.688443:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388182272 00000100:00100000:2.0:1782480886.688446:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388182272 00000100:00100000:1.0:1782480886.688540:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782480886.688551:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfa79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388182784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480886.688581:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480886.688610:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388182144 00000100:00100000:1.0:1782480886.688613:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388182144 00000100:00100000:1.0:1782480886.688649:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1782480886.688656:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388182144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480886.688712:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb77b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388182144:12345-0@lo:400:kworker.0 Request processed in 58us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480886.688718:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:3.0:1782480886.691452:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782480886.691465:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388182656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480886.691567:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388182656:12345-0@lo:400:kworker.0 Request processed in 106us (3751us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480886.691573:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782480886.691602:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388182784 00000100:00100000:3.0:1782480886.691609:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388182784 00000100:00100000:3.0:1782480886.691636:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782480886.691642:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388182784:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480886.691691:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480886.691737:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388182784:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (3155us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480886.691743:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782480886.691818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.691840:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366142208 00000100:00100000:3.0:1782480886.691844:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366142208 00000100:00100000:3.0:1782480886.691868:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:3.0:1782480886.691874:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fecc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2352:x1869066366142208:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:3.0:1782480886.691907:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.691928:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.691938:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782480886.691942:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782480886.691946:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.691994:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 6 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.692009:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 6 pid: 6608 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480886.692023:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6609:1869066388182912:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480886.692374:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c540 going to sleep for 11 seconds 00000100:00100000:0.0:1782480886.693810:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782480886.693825:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388182528:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480886.693903:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388182528:12345-0@lo:400:kworker.0 Request processed in 83us (6387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480886.693910:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1782480886.693977:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388182144:0@lo:400:kworker.0 00000100:00100000:0.0:1782480886.693990:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:0.0:1782480886.693996:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:0.0:1782480886.694017:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7c67f0380, transno 4294967301 00000100:00100000:2.0:1782480886.694214:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388182528:0@lo:400:kworker.0 00000100:00100000:3.0:1782480886.694406:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:3.0:1782480886.694415:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388182272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480886.694454:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388182272:12345-0@lo:400:kworker.0 Request processed in 40us (6719us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480886.694460:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00080000:1.0:1782480886.694725:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480886.694828:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388182656:0@lo:400:kworker.0 00000100:00100000:1.0:1782480886.700566:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfa79c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388182784:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480886.700742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00080000:1.0:1782480886.700763:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480886.700770:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480886.701431:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366142336 00000100:00100000:2.0:1782480886.701439:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366142336 00002000:00100000:2.0:1782480886.701486:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91d7dfa79c00 x1869066366142336/t0(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:642/0 lens 504/0 e 0 to 0 dl 1782480897 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782480886.701497:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7dfa79c00 with x1869066366142336 ext(0->8) 00010000:00010000:2.0:1782480886.701506:0:6613:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 7 pid: 6608 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.701589:0:6613:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 7 pid: 6608 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480886.701599:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d7dfa79c00 00000100:00100000:2.0:1782480886.701629:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:2.0:1782480886.701639:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366142336:12345-192.168.201.58@tcp:4:lfs.0 00000100:00100000:2.0:1782480886.702356:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2350:x1869066366142336:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 715us (1614us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1782480886.702364:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00002000:00100000:2.0:1782480886.702373:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff91d7dfa79c00 x1869066366142336/t4294967302(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:642/0 lens 504/448 e 0 to 0 dl 1782480897 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1782480886.702380:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7dfa79c00 with x1869066366142336 ext(0->8) 00010000:00010000:2.0:1782480886.702386:0:6613:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 9 pid: 6608 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.702398:0:6613:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 9 pid: 6608 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480886.702416:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d7dfa79c00 00000100:00100000:2.0:1782480886.702465:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f5880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6609:1869066388182912:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480886.702785:0:6609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480886.710828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480886.710907:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddf100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388182272:0@lo:400:kworker.0 00000100:00100000:3.0:1782480886.711062:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366142464 00000100:00100000:3.0:1782480886.711071:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366142464 00010000:00010000:3.0:1782480886.711260:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 9 pid: 6608 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480886.711309:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:3.0:1782480886.711320:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2353:x1869066366142464:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480886.711336:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1782480886.711357:0:5786:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1782480886.711360:0:5786:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1782480886 00002000:00010000:3.0:1782480886.711362:0:5786:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1782480886 00002000:00010000:3.0:1782480886.711371:0:5786:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1782480886 00010000:00010000:3.0:1782480886.711378:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 9 pid: 6608 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.711393:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 9 pid: 6608 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.711422:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf57ef lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fda3 expref: 9 pid: 6608 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.711445:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782480886.711451:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782480886.711457:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.711468:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.713841:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480886.714047:0:6609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.714078:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.714125:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.714202:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.714212:0:6609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.714219:0:6609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480886.714224:0:6609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.714234:0:6609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.714262:0:6609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.714271:0:6609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000073dab202/0x4776e02a9acf582e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480886.714399:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fecc0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2352:x1869066366142208:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 22518us (22576us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480886.714410:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:1.0:1782480886.714771:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2353:x1869066366142464:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 3451us (3952us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480886.714780:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:2.0:1782480886.718677:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.721796:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366142720 00000100:00100000:3.0:1782480886.721810:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366142720 00000100:00100000:3.0:1782480886.721904:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:3.0:1782480886.721913:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:10490:x1869066366142720:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:3.0:1782480886.721975:0:5805:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5820 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdb8 expref: 38 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782480886.722430:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:1.0:1782480886.722508:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00000001:00080000:1.0:1782480886.722872:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00010000:00010000:1.0:1782480886.722930:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.722948:0:5805:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd95 expref: 42 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.722958:0:5805:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.723236:0:5805:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd95 expref: 42 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.723263:0:5805:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd95 expref: 42 pid: 5802 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480886.723280:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ed018a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5805:1869066388183040:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480886.723390:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96a80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480886.728779:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480886.729365:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366142848 00000100:00100000:0.0:1782480886.729376:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366142848 00010000:00010000:0.0:1782480886.729419:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd95 expref: 43 pid: 5802 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480886.729463:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:0.0:1782480886.729473:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+43:2351:x1869066366142848:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480886.729488:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480886.729495:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd95 expref: 43 pid: 5802 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.729508:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd95 expref: 43 pid: 5802 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.729544:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c610b800) 00010000:00010000:0.0:1782480886.729549:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.729560:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.729568:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480886.729606:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480886.729691:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+43:2351:x1869066366142848:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 217us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480886.729699:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00010000:00010000:1.0:1782480886.733204:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf57da lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd95 expref: 42 pid: 5802 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480886.733234:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ed018a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5805:1869066388183040:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480886.733338:0:5805:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.733371:0:5805:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.733378:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782480886.734206:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000001:00080000:1.0:1782480886.734427:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:1.0:1782480886.735124:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ed018a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1869066388183168:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782480886.735193:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480886.735235:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96600 going to sleep for 11 seconds 00000100:00100000:0.0:1782480886.735562:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388183168 00000100:00100000:0.0:1782480886.735570:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388183168 00000100:00100000:0.0:1782480886.735626:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480886.735634:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1869066388183168:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782480886.735730:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed018e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1869066388183168:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 96us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480886.735737:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1782480886.735911:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ed018a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1869066388183168:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782480886.736467:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00000100:00100000:1.0:1782480886.736713:0:5805:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ed018a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1869066388183296:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1782480886.736756:0:5805:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480886.736771:0:5805:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480886.738114:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388183296 00000100:00100000:0.0:1782480886.738126:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388183296 00000100:00100000:0.0:1782480886.738181:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480886.738190:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5805:x1869066388183296:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1782480886.738591:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5805:x1869066388183296:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 401us (1832us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1782480886.738600:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782480886.738830:0:5805:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ed018a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5805:1869066388183296:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1782480886.738896:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:1.0:1782480886.738937:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.738947:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.738955:0:5805:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.738962:0:5805:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480886.738975:0:5805:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.738983:0:5805:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.738998:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c610b800) 00010000:00010000:1.0:1782480886.739001:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782480886.739359:0:5805:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.739368:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5835 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480886.739643:0:5805:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782480886.739786:0:5805:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 64 off8384 00000004:00080000:1.0:1782480886.739796:0:5805:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 417301136512ns, next at 418301134697ns, rc = 0 00000001:00080000:1.0:1782480886.739804:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967388 00010000:00010000:1.0:1782480886.739839:0:5805:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c610b800) 00010000:00010000:1.0:1782480886.739842:0:5805:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782480886.739849:0:5805:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5820 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdb8 expref: 46 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480886.740390:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b64c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+45:10490:x1869066366142720:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 18475us (21735us total) trans 4294967389 rc 0/0 00000100:00100000:1.0:1782480886.740400:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000020:00080000:1.0:1782480886.740405:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1782480886.747435:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1782480886.750785:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480886.753402:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366142976 00000100:00100000:0.0:1782480886.753419:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366142976 00000100:00100000:1.0:1782480886.758466:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:1.0:1782480886.758482:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+45:10490:x1869066366142976:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782480886.758509:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480886.759382:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf583c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fdbf expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.759460:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf583c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdbf expref: 46 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.759474:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf583c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdbf expref: 46 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480886.759494:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:1.0:1782480886.759498:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480886.759501:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55e000, rc 0) 00000100:00100000:1.0:1782480886.759725:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+46:10490:x1869066366142976:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1245us (12299us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480886.759732:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:2.0:1782480886.769052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480886.771460:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366143232 00000100:00100000:1.0:1782480886.771477:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366143232 00000100:00100000:1.0:1782480886.771562:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:1.0:1782480886.771574:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+46:10490:x1869066366143232:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1782480886.771867:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb77100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+47:10490:x1869066366143232:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 293us (2879us total) trans 4294967390 rc 0/0 00000100:00100000:1.0:1782480886.771876:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:2.0:1782480886.888084:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.888254:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366143360 00000100:00100000:3.0:1782480886.888265:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366143360 00000100:00100000:3.0:1782480886.888327:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:3.0:1782480886.888336:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+47:10500:x1869066366143360:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1782480886.888412:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5843 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888430:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888442:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888458:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf584a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888465:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf584a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888472:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf584a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888701:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888712:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888719:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480886.888764:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888793:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5843 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888799:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5843 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888806:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888813:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ac00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480886.888817:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5843 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888825:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5843 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888838:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480886.888842:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480886.888847:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5843 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888853:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5843 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888867:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf584a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888873:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf584a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888878:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf584a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888889:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ae00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480886.888891:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf584a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888897:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf584a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888905:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1100) 00010000:00010000:3.0:1782480886.888908:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480886.888911:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf584a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888917:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf584a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888935:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888941:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888946:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888951:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480886.888953:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888959:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888976:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480886.888978:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480886.888981:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.888986:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5851 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480886.889230:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+47:10500:x1869066366143360:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 892us (1155us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480886.889248:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:2.0:1782480886.978425:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480886.978529:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366143616 00000100:00100000:3.0:1782480886.978539:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366143616 00000100:00100000:3.0:1782480886.978655:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:3.0:1782480886.978706:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+47:10503:x1869066366143616:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480886.978727:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480886.978752:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5858 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fdc6 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.978841:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf585f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.978857:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf585f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.978869:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf585f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.978882:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5866 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.978902:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.978908:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979064:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf586d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979072:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf586d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979079:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf586d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480886.979090:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782480886.979262:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf585f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979270:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf585f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979278:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf585f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979284:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ae00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480886.979289:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf585f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979296:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf585f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979319:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480886.979322:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480886.979327:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf585f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979334:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf585f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979347:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5866 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979353:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5866 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979359:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979365:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ac00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480886.979368:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5866 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979374:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5866 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979380:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1100) 00010000:00010000:3.0:1782480886.979383:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480886.979386:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5866 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979391:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5866 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979447:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5858 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdc6 expref: 50 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979460:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf586d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdc6 expref: 49 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480886.979467:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480886.979469:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480886.979472:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b800, rc 0) 00000100:00100000:3.0:1782480886.979537:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+49:10503:x1869066366143616:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 835us (1125us total) trans 4294967391 rc 0/0 00000100:00100000:3.0:1782480886.979545:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:1.0:1782480886.983697:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480886.983809:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366143744 00000100:00100000:2.0:1782480886.983820:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366143744 00000100:00100000:2.0:1782480886.983879:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:2.0:1782480886.983889:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+49:10503:x1869066366143744:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:2.0:1782480886.983965:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf587b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.983982:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf587b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.984005:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf587b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.984039:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf587b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.984076:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf587b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.984307:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf587b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.984315:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2c400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480886.984319:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf587b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.984329:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf587b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.984344:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:2.0:1782480886.984348:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480886.984354:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf587b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480886.984361:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf587b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480886.984453:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed018000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+49:10503:x1869066366143744:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 564us (765us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480886.984462:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:2.0:1782480886.987373:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480886.987498:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366144000 00000100:00100000:1.0:1782480886.987508:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366144000 00000100:00100000:1.0:1782480886.987581:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:1.0:1782480886.987591:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+49:10503:x1869066366144000:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1782480886.987885:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+50:10503:x1869066366144000:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 295us (521us total) trans 4294967392 rc 0/0 00000100:00100000:1.0:1782480886.987894:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:1.0:1782480887.102804:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480887.102908:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366144256 00000100:00100000:3.0:1782480887.102919:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366144256 00000100:00100000:3.0:1782480887.103001:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 104 00000100:00100000:3.0:1782480887.103021:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+50:10513:x1869066366144256:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1782480887.103050:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480887.103052:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1782480887.103091:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf57fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdaa expref: 50 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.103117:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480887.103122:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480887.103137:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5882 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fdcd expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.103282:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5889 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.103296:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.103307:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5889 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480887.103319:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1782480887.103458:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5882 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdcd expref: 52 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.103473:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5889 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdcd expref: 51 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.103481:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480887.103484:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480887.103487:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ac00, rc 0) 00000100:00100000:3.0:1782480887.103555:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:10513:x1869066366144256:12345-192.168.201.58@tcp:101:bash.0 Request processed in 544us (762us total) trans 4294967393 rc 0/0 00000100:00100000:3.0:1782480887.103563:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 104 00000100:00080000:1.0:1782480887.105779:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480887.117243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480887.117610:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366144512 00000100:00100000:3.0:1782480887.117622:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366144512 00000100:00100000:3.0:1782480887.117718:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 105 00000100:00100000:3.0:1782480887.117729:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:10513:x1869066366144512:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:3.0:1782480887.117794:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:3.0:1782480887.117830:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf5889 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdcd expref: 51 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.117852:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf586d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdc6 expref: 50 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.117862:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480887.117867:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480887.118099:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.118113:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.118122:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480887.118355:0:5802:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967394 00000004:00010000:3.0:1782480887.118380:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000040b59e4 reply state 00000000a04df4b8 transno 4294967395 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480887.118391:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480887.118498:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:10513:x1869066366144512:12345-192.168.201.58@tcp:36:bash.0 Request processed in 770us (1273us total) trans 4294967395 rc 0/0 00000100:00100000:3.0:1782480887.118506:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 105 00000020:00080000:3.0:1782480887.118510:0:5802:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1782480887.121838:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.121861:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.121891:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.121898:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480887.121904:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.121913:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.121933:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480887.121937:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480887.121943:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.121950:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf5897 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480887.135387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480887.135484:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366144640 00000100:00100000:3.0:1782480887.135493:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366144640 00000100:00100000:3.0:1782480887.135555:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:3.0:1782480887.135566:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:10513:x1869066366144640:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1782480887.135591:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480887.135612:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf589e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fdd4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.135738:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.135754:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.135781:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480887.135814:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782480887.135818:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480887.135836:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.135863:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf589e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdd4 expref: 53 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.135880:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdd4 expref: 52 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.135888:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480887.135891:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480887.135895:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b800, rc 0) 00000100:00100000:3.0:1782480887.135946:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:10513:x1869066366144640:12345-192.168.201.58@tcp:101:bash.0 Request processed in 382us (571us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480887.135953:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:2.0:1782480887.140509:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480887.140726:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366144896 00000100:00100000:1.0:1782480887.140736:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366144896 00000100:00100000:1.0:1782480887.140845:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:1.0:1782480887.140856:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:10513:x1869066366144896:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:1.0:1782480887.141122:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10513:x1869066366144896:12345-192.168.201.58@tcp:35:bash.0 Request processed in 268us (1050us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1782480887.141131:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:1.0:1782480887.210795:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480887.210874:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366145024 00000100:00100000:3.0:1782480887.210882:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366145024 00000100:00100000:3.0:1782480887.210929:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 107 00000100:00100000:3.0:1782480887.210936:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+53:10519:x1869066366145024:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480887.210958:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480887.210974:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58ac lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fddb expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.211093:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf58b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.211108:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf58b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.211119:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf58b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480887.211183:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1782480887.211187:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480887.211213:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf58b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.211263:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58ac lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fddb expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.211287:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf58b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fddb expref: 54 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.211296:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480887.211299:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480887.211302:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ac00, rc 0) 00000100:00100000:3.0:1782480887.211423:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10519:x1869066366145024:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 485us (635us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480887.211430:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 107 00000100:00100000:2.0:1782480887.216765:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480887.216907:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366145152 00000100:00100000:3.0:1782480887.216917:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366145152 00000100:00100000:3.0:1782480887.216976:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 108 00000100:00100000:3.0:1782480887.216983:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10519:x1869066366145152:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480887.217003:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480887.217023:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58ba lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fde2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217116:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf58c1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217131:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf58c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217144:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf58c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217159:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf58c8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217166:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf58c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217172:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf58c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217519:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf58cf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217527:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf58cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217532:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf58cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480887.217575:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1782480887.217579:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480887.217594:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf58cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217603:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf58cf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217609:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf58c1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217613:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf58c1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217618:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf58c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217623:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ae00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480887.217625:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf58c1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217630:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf58c1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217638:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480887.217640:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480887.217643:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf58c1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217646:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf58c1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217768:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf58c8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217773:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf58c8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217777:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf58c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217780:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480887.217782:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf58c8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217785:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf58c8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217791:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c51d1100) 00010000:00010000:3.0:1782480887.217792:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480887.217794:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf58c8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217798:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf58c8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217823:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58ba lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde2 expref: 56 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217831:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf58cf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde2 expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.217844:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480887.217845:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480887.217847:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ba00, rc 0) 00000100:00100000:3.0:1782480887.217946:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4dde680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10519:x1869066366145152:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 963us (1192us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480887.217952:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 108 00000100:00100000:2.0:1782480887.223527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480887.223647:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366145280 00000100:00100000:1.0:1782480887.223938:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366145280 00000100:00100000:1.0:1782480887.224047:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1782480887.224066:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:2353:x1869066366145280:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480887.224081:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480887.224106:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf58cf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde2 expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480887.224123:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:1.0:1782480887.224128:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480887.224192:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:2353:x1869066366145280:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 129us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480887.224200:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1782480887.224298:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480887.224394:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366145536 00000100:00100000:2.0:1782480887.224398:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366145536 00000100:00100000:2.0:1782480887.224435:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 109 00000100:00100000:2.0:1782480887.224443:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10519:x1869066366145536:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1782480887.224460:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480887.224476:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf58d6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fde9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480887.224568:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480887.224583:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdd4 expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480887.224592:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480887.224625:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdd4 expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480887.224638:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdd4 expref: 55 pid: 5803 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480887.224652:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388183424:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480887.224752:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495c00 going to sleep for 11 seconds 00000100:00100000:2.0:1782480887.227600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480887.227846:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366145664 00000100:00100000:3.0:1782480887.227853:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366145664 00010000:00010000:3.0:1782480887.227884:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdd4 expref: 56 pid: 5803 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480887.227913:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:3.0:1782480887.227919:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+56:2351:x1869066366145664:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480887.227929:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480887.227934:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdd4 expref: 56 pid: 5803 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.227943:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdd4 expref: 56 pid: 5803 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.227960:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480887.227963:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.227970:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.227988:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.228009:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480887.228068:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+56:2351:x1869066366145664:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 149us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480887.228075:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00010000:00010000:0.0:1782480887.228329:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf58a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdd4 expref: 55 pid: 5803 timeout: 517 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480887.228350:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddca80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388183424:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480887.228371:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480887.228393:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480887.228399:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480887.228429:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1782480887.228559:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf58d6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde9 expref: 56 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480887.228571:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde9 expref: 55 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480887.228576:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:0.0:1782480887.228578:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782480887.228579:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2ca00, rc 0) 00000100:00100000:0.0:1782480887.228608:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10519:x1869066366145536:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 4166us (4311us total) trans 4294967397 rc 0/0 00000100:00100000:0.0:1782480887.228615:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 109 00000100:00100000:2.0:1782480887.233686:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480887.233813:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366145920 00000100:00100000:1.0:1782480887.233822:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366145920 00000100:00100000:1.0:1782480887.233881:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:1.0:1782480887.233891:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10519:x1869066366145920:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:1.0:1782480887.233907:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480887.233932:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf583c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdbf expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480887.233947:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:1.0:1782480887.233950:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480887.234040:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10519:x1869066366145920:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 150us (386us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480887.234046:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1782480887.238064:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480887.238621:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366146048 00000100:00100000:0.0:1782480887.238631:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366146048 00000100:00100000:0.0:1782480887.238711:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 110 00000100:00100000:0.0:1782480887.238741:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10519:x1869066366146048:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:0.0:1782480887.238847:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480887.238865:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480887.238890:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782480887.240690:0:6840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1782480887.240918:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10519:x1869066366146048:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 2193us (2867us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480887.240930:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 110 00000100:00100000:2.0:1782480887.245790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480887.245954:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366146176 00000100:00100000:3.0:1782480887.245966:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366146176 00000100:00100000:3.0:1782480887.246038:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 111 00000100:00100000:3.0:1782480887.246049:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:10519:x1869066366146176:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480887.246078:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480887.246100:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fdf0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.246487:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.246500:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58f2 lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdf0 expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.246522:0:5802:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.246538:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58f2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdf0 expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.246562:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480887.246566:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480887.246570:0:5802:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58f2 lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdf0 expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480887.246578:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b400, rc 0) 00000100:00100000:3.0:1782480887.246649:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10519:x1869066366146176:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 601us (867us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480887.246703:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 111 00010000:00010000:0.0:1782480887.778540:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782480888.094946:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782480888.094958:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480888.095017:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:3.0:1782480888.095026:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782480888.095157:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388183552:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782480888.095286:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c180 going to sleep for 11 seconds 00000100:00100000:3.0:1782480888.103305:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f6300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388183552:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782480888.103805:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480888.103976:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366146304 00000100:00100000:1.0:1782480888.103985:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366146304 00000100:00100000:1.0:1782480888.104061:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00100000:1.0:1782480888.104072:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10520:x1869066366146304:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782480888.104104:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782480888.104228:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10520:x1869066366146304:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 149us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480888.104237:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 112 00000100:00100000:2.0:1782480888.118172:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.118303:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366146432 00000100:00100000:0.0:1782480888.118315:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366146432 00000100:00100000:0.0:1782480888.118372:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 113 00000100:00100000:0.0:1782480888.118383:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10520:x1869066366146432:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782480888.118476:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf58f9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118494:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf58f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118505:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf58f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118565:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5900 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118573:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5900 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118580:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5900 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118637:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118648:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118654:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480888.118747:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1782480888.118751:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480888.118767:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118780:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf58f9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118787:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf58f9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118794:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf58f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118807:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480888.118812:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf58f9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118819:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf58f9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118832:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:0.0:1782480888.118841:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480888.118846:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf58f9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118853:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf58f9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118865:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5900 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118870:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5900 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118875:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5900 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118880:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480888.118882:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5900 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118888:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5900 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118895:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480888.118897:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480888.118900:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5900 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118904:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5900 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118921:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118934:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118939:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118944:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480888.118947:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118953:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118961:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:0.0:1782480888.118963:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480888.118966:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.118971:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5907 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480888.119052:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10520:x1869066366146432:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 669us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480888.119061:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 113 00000100:00100000:3.0:1782480888.123924:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480888.124089:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366146688 00000100:00100000:1.0:1782480888.124101:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366146688 00000100:00100000:1.0:1782480888.124163:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:1.0:1782480888.124173:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:10520:x1869066366146688:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480888.124195:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480888.124247:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf590e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fdf7 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124354:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5915 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124368:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124380:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480888.124392:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782480888.124501:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5915 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124508:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5915 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124514:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5915 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124519:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55f600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480888.124523:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5915 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124529:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5915 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124540:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:1.0:1782480888.124544:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782480888.124548:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5915 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124564:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5915 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124607:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf590e lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdf7 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124617:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:1.0:1782480888.124619:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480888.124623:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf590e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdf7 expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.124633:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55ee00, rc 0) 00000100:00100000:1.0:1782480888.124727:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+56:10520:x1869066366146688:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 555us (813us total) trans 4294967398 rc 301/301 00000100:00100000:1.0:1782480888.124734:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 114 00000100:00100000:2.0:1782480888.138102:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.138517:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366146816 00000100:00100000:3.0:1782480888.138529:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366146816 00000100:00100000:3.0:1782480888.138649:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:3.0:1782480888.138713:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+56:10520:x1869066366146816:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1782480888.138757:0:5802:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1782480888.138881:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+56:10520:x1869066366146816:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 222us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480888.138907:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 115 00000100:00100000:2.0:1782480888.146129:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480888.146324:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366147072 00000100:00100000:1.0:1782480888.146334:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366147072 00000100:00100000:1.0:1782480888.146391:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:1.0:1782480888.146401:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+56:10520:x1869066366147072:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480888.146423:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480888.146427:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782480888.146453:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ac00/0x4776e02a9acf58b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fddb expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.146483:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:1.0:1782480888.146489:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480888.146515:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5923 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fdfe expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480888.146986:0:5803:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:1.0:1782480888.149640:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf592a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.149677:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf592a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.149690:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf592a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.149783:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5923 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdfe expref: 58 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.149807:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf592a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdfe expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.149817:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c8d19300) 00010000:00010000:1.0:1782480888.149820:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480888.149824:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55f800, rc 0) 00000100:00100000:1.0:1782480888.149917:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+57:10520:x1869066366147072:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 3516us (3796us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1782480888.149926:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 116 00000100:00100000:1.0:1782480888.167436:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.167589:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366147328 00000100:00100000:0.0:1782480888.167600:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366147328 00000100:00100000:0.0:1782480888.167681:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:0.0:1782480888.167693:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+57:10520:x1869066366147328:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782480888.167756:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480888.167795:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf592a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdfe expref: 57 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.167812:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c8d19300) 00010000:00010000:0.0:1782480888.167823:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480888.167844:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5938 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.167857:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.167866:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.167879:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf593f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x37570eee bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.167886:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf593f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37570eee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.167893:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf593f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37570eee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.167984:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5938 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168253:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5938 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168263:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168269:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480888.168280:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5938 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168288:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5938 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168298:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:0.0:1782480888.168302:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480888.168306:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5938 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168313:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5938 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168327:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf593f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x37570eee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168333:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf593f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37570eee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168339:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf593f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37570eee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168345:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480888.168347:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf593f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37570eee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168353:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf593f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x37570eee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168359:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x37570eee (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480888.168361:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480888.168367:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf593f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x37570eee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.168374:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf593f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x37570eee bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480888.168470:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f99c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+56:10520:x1869066366147328:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 778us (1045us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782480888.169401:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:2.0:1782480888.175421:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.175506:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366147456 00000100:00100000:0.0:1782480888.175516:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366147456 00000100:00100000:0.0:1782480888.175575:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:0.0:1782480888.175584:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+56:10520:x1869066366147456:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480888.175604:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480888.175627:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5946 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe05 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.175692:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.175707:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.175719:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.175825:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5946 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe05 expref: 58 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.175843:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe05 expref: 57 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.175860:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:0.0:1782480888.175863:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782480888.175867:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a200, rc 0) 00000100:00100000:0.0:1782480888.175936:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+57:10520:x1869066366147456:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 352us (525us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480888.175944:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:2.0:1782480888.181559:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.181809:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366147712 00000100:00100000:3.0:1782480888.181825:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366147712 00000100:00100000:3.0:1782480888.181936:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:3.0:1782480888.181948:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+57:10520:x1869066366147712:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782480888.182088:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.182109:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.182122:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782480888.182460:0:5802:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 88 off8560 00000004:00080000:3.0:1782480888.182482:0:5802:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 418743811821ns, next at 419743809418ns, rc = 0 00000004:00010000:3.0:1782480888.182582:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000c2a2f055 reply state 00000000368c5efe transno 4294967400 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480888.182593:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480888.182746:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5a8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:10520:x1869066366147712:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 799us (1196us total) trans 4294967400 rc 0/0 00000100:00100000:3.0:1782480888.182755:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:1.0:1782480888.191071:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.191133:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366147840 00000100:00100000:3.0:1782480888.191152:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366147840 00000100:00100000:3.0:1782480888.191211:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:3.0:1782480888.191230:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:10520:x1869066366147840:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480888.191254:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480888.191290:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf595b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe0c expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.191367:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf595b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe0c expref: 60 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.191385:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf595b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe0c expref: 60 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.191407:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:3.0:1782480888.191411:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480888.191415:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ae00, rc 0) 00000100:00100000:3.0:1782480888.191481:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f99880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:10520:x1869066366147840:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 253us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480888.191489:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00010000:00010000:0.0:1782480888.192432:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.192446:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.192453:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.192459:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480888.192463:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.192471:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.192486:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:0.0:1782480888.192489:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782480888.192493:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.192499:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5954 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.197901:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.198565:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366147968 00000100:00100000:3.0:1782480888.198574:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366147968 00000100:00080000:1.0:1782480888.198634:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480888.198654:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:3.0:1782480888.198694:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366147968:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1782480888.199047:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ab800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2350:x1869066366147968:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 356us (1155us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1782480888.199077:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:2.0:1782480888.204235:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.204444:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366148224 00000100:00100000:0.0:1782480888.204456:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366148224 00000100:00100000:0.0:1782480888.204595:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:0.0:1782480888.204608:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:10520:x1869066366148224:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782480888.205732:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:10520:x1869066366148224:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1119us (1512us total) trans 4294967401 rc 0/0 00000100:00100000:2.0:1782480888.205744:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:1.0:1782480888.209393:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.209547:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366148480 00000100:00100000:0.0:1782480888.209558:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366148480 00000100:00100000:0.0:1782480888.210831:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:0.0:1782480888.210850:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:10520:x1869066366148480:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782480888.211073:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f98380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:10520:x1869066366148480:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 231us (1690us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480888.211084:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:0.0:1782480888.213770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.213860:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366148608 00000100:00100000:3.0:1782480888.213870:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366148608 00000100:00100000:3.0:1782480888.213964:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:3.0:1782480888.213985:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:10520:x1869066366148608:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480888.214012:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480888.214036:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5962 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe13 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.214137:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5969 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.214154:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.214165:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480888.214203:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480888.214237:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5969 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.214265:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5962 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe13 expref: 62 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.214284:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5969 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe13 expref: 61 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.214294:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:3.0:1782480888.214296:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782480888.214300:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a800, rc 0) 00000100:00100000:3.0:1782480888.214380:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:10520:x1869066366148608:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 398us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480888.214386:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:2.0:1782480888.218249:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.218343:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366148736 00000100:00100000:3.0:1782480888.218357:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366148736 00000100:00100000:3.0:1782480888.218435:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:3.0:1782480888.218463:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2351:x1869066366148736:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480888.218495:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480888.218516:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf5970 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe1a expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480888.218545:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e7ff8, blocks: 0x1 00010000:00010000:3.0:1782480888.218564:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=418s v=(0 0) 00010000:00010000:3.0:1782480888.218569:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480888.218579:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf5970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe1a expref: 10 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.218596:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf5970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe1a expref: 10 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.218609:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a000, rc 0) 00000100:00100000:3.0:1782480888.218697:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ff800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:2351:x1869066366148736:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 237us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480888.218705:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:2.0:1782480888.222052:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.222144:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366148992 00000100:00100000:3.0:1782480888.222154:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366148992 00000100:00100000:3.0:1782480888.222223:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:3.0:1782480888.222235:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:10520:x1869066366148992:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782480888.222354:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:10520:x1869066366148992:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 122us (313us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480888.222362:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:2.0:1782480888.225797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.225890:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366149120 00000100:00100000:0.0:1782480888.225900:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366149120 00000100:00100000:0.0:1782480888.225956:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:0.0:1782480888.225966:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:10520:x1869066366149120:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480888.225984:0:6607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480888.226010:0:6607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe21 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.226043:0:6607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf5970 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe1a expref: 11 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.226053:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480888.226079:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480888.226086:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 11 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.226125:0:6607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf5970 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe1a expref: 11 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.226140:0:6607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf5970 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe1a expref: 11 pid: 6608 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480888.226154:0:6607:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6607:1869066388183680:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480888.226257:0:6607:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dc806840 going to sleep for 11 seconds 00000100:00100000:1.0:1782480888.230465:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480888.230547:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366149248 00000100:00100000:2.0:1782480888.230557:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366149248 00010000:00010000:2.0:1782480888.230599:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf5970 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe1a expref: 12 pid: 6608 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.230641:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:2.0:1782480888.230652:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d1301c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:2350:x1869066366149248:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480888.230777:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480888.230802:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf5970 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe1a expref: 12 pid: 6608 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.230817:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf5970 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe1a expref: 12 pid: 6608 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.230864:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480888.230868:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480888.230877:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 12 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.230887:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 12 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.230926:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 12 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.230939:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5787:1869066388183808:192.168.201.58@tcp:105: 00000100:00100000:2.0:1782480888.231014:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495780 going to sleep for 11 seconds 00010000:00010000:0.0:1782480888.231259:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf5970 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe1a expref: 12 pid: 6608 timeout: 518 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480888.231274:0:6607:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006ae680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6607:1869066388183680:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480888.231301:0:6607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 11 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.231311:0:6607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782480888.231356:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+11:10520:x1869066366149120:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 5391us (5568us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480888.231364:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:1.0:1782480888.242402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.242511:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366149376 00000100:00100000:0.0:1782480888.242521:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366149376 00002000:00100000:0.0:1782480888.242577:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91d7f4f9a300 x1869066366149376/t0(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:644/0 lens 504/0 e 0 to 0 dl 1782480899 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782480888.242601:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7f4f9a300 with x1869066366149376 ext(0->12) 00002000:00010000:0.0:1782480888.242608:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7f4f9a300 00000100:00100000:0.0:1782480888.242650:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1782480888.242694:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+11:2351:x1869066366149376:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1782480888.243183:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:2351:x1869066366149376:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 523us (791us total) trans 4294967308 rc 0/0 00000100:00100000:0.0:1782480888.243192:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00002000:00100000:0.0:1782480888.243199:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff91d7f4f9a300 x1869066366149376/t4294967308(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:644/0 lens 504/448 e 0 to 0 dl 1782480899 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782480888.243208:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7f4f9a300 with x1869066366149376 ext(0->12) 00002000:00010000:0.0:1782480888.243212:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7f4f9a300 00000100:00100000:2.0:1782480888.243443:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dc000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5787:1869066388183808:192.168.201.58@tcp:105: 00010000:00010000:2.0:1782480888.243473:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480888.243498:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d1301c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:2350:x1869066366149248:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 12849us (13044us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480888.243506:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:2.0:1782480888.248036:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480888.248400:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366149504 00000100:00100000:1.0:1782480888.248411:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366149504 00000100:00100000:1.0:1782480888.248483:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 124 00000100:00100000:1.0:1782480888.248494:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:10520:x1869066366149504:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1782480888.348187:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000020:00080000:2.0:1782480888.348224:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d7c6ba2b40 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:2.0:1782480888.348229:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4a5f700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d7c6ba2180 00000020:00080000:2.0:1782480888.348233:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4a5ff00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d7ef5fdc00 00000001:00080000:2.0:1782480888.348269:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:2.0:1782480888.348304:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1782480888.348324:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d7efe96600 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:2.0:1782480888.348328:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c3db1400 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d7efe966c0 00000020:00080000:2.0:1782480888.348331:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c3db1500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d7c9228c00 00000020:00080000:2.0:1782480888.348346:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000001:00080000:2.0:1782480888.348353:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967401 is committed 00000004:00080000:2.0:1782480888.348363:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000004:00080000:2.0:1782480888.348390:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1782480888.348464:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000100:00100000:2.0:1782480888.348726:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388183936:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1782480888.348804:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480888.348884:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480888.348893:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388184064:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1782480888.348904:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388183936 00000100:00100000:2.0:1782480888.348923:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480888.348956:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388184192:0@lo:2:osp-syn-0-0.0 00000100:00100000:2.0:1782480888.348979:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480888.349011:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388184064 00000100:00100000:2.0:1782480888.349018:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388184064 00000100:00100000:2.0:1782480888.349074:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388184192 00000100:00100000:2.0:1782480888.349078:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388184192 00000100:00100000:2.0:1782480888.349091:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782480888.349098:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+8:3310:x1869066388184064:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1782480888.349123:0:8498:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00010000:00010000:2.0:1782480888.349150:0:8498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.349173:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5740 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd80 expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.349196:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1782480888.349201:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480888.349205:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.349247:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5740 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd80 expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.349261:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5740 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd80 expref: 11 pid: 6608 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.349274:0:8498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8498:1869066388184320:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480888.349334:0:8498:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495600 going to sleep for 11 seconds 00000100:00100000:2.0:1782480888.349349:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782480888.349357:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3312:x1869066388184192:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:2.0:1782480888.349498:0:6609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1782480888.349502:0:6609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782480888 00002000:00010000:2.0:1782480888.349504:0:6609:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782480888.349506:0:6609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1782480888 -> 1782480888 00002000:00010000:2.0:1782480888.349508:0:6609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782480888.349546:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+9:3312:x1869066388184192:12345-0@lo:2:osp-syn-0-0.0 Request processed in 189us (565us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1782480888.349553:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1782480888.349595:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7ef5ddc00/2, rc 0, transno 4294967309 00000100:00100000:2.0:1782480888.349607:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388184192:0@lo:2:osp-syn-0-0.0 00000100:00080000:2.0:1782480888.349628:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480888.351757:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:10520:x1869066366149504:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 103250us (103718us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480888.351771:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 124 00000020:00080000:1.0:1782480888.352809:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1782480888.353046:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388183936 00000100:00100000:0.0:1782480888.353152:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1782480888.353165:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388183936:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782480888.353203:0:6608:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00002000:00010000:0.0:1782480888.353264:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a3e7ff6, atime: 0x6a3e7ff6, ctime: 0x6a3e7ff6, blocks: 0x1 00010000:00010000:0.0:1782480888.353274:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000267d8eb2/0x4776e02a9acf5985 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.353295:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=418s v=(0 0) 00010000:00010000:0.0:1782480888.353300:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480888.353317:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000267d8eb2/0x4776e02a9acf5985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.353364:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000267d8eb2/0x4776e02a9acf5985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.353375:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000267d8eb2/0x4776e02a9acf5985 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.353384:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000267d8eb2/0x4776e02a9acf5985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.353407:0:6608:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1782480888.354206:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3310:x1869066388183936:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1038us (5395us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1782480888.354226:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:1.0:1782480888.355749:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782480888.355806:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480888.355822:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000267d8eb2/0x4776e02a9acf5985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.355836:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782480888.355841:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000267d8eb2/0x4776e02a9acf5985 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.355852:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000267d8eb2/0x4776e02a9acf5985 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.355876:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000267d8eb2/0x4776e02a9acf5985 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.355884:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000267d8eb2/0x4776e02a9acf5985 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.355913:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480888.355915:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480888.355917:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480888.356476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480888.356586:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366149632 00000100:00100000:1.0:1782480888.356597:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366149632 00010000:00010000:1.0:1782480888.356651:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5740 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd80 expref: 12 pid: 6608 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480888.356727:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:1.0:1782480888.356739:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:2352:x1869066366149632:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480888.356760:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480888.356767:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5740 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd80 expref: 12 pid: 6608 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.356782:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5740 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd80 expref: 12 pid: 6608 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.356840:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480888.356845:0:5786:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480888.356852:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.356864:0:5786:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.356908:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480888.356986:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:2352:x1869066366149632:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 249us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480888.356996:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 54 00010000:00010000:1.0:1782480888.357062:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5740 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd80 expref: 11 pid: 6608 timeout: 518 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480888.357082:0:8498:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:8498:1869066388184320:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480888.357110:0:8498:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.357122:0:8498:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.357130:0:8498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.357155:0:8498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.357162:0:8498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.357183:0:8498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782480888.357980:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+9:3310:x1869066388184064:12345-0@lo:6:osp-syn-0-0.0 Request processed in 8875us (9051us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1782480888.357990:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:1.0:1782480888.358024:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782480888.358032:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.358044:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2c400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782480888.358049:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.358060:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.358079:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.358086:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000aada7e6f/0x4776e02a9acf597e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.358115:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480888.358117:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480888.358119:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1782480888.358300:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7ef5dd880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1782480888.358316:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388184064:0@lo:6:osp-syn-0-0.0 00000004:00080000:3.0:1782480888.358330:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7ef5dd500/2, rc 0, transno 4294967304 00000100:00100000:3.0:1782480888.358335:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388183936:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782480888.363353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480888.363466:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366149760 00000100:00100000:2.0:1782480888.363492:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366149760 00000100:00100000:2.0:1782480888.363560:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:2.0:1782480888.363570:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+11:2350:x1869066366149760:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1782480888.492161:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+11:2350:x1869066366149760:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 128574us (128807us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480888.492177:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000001:00080000:1.0:1782480888.494534:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000001:00080000:1.0:1782480888.494956:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:2.0:1782480888.500433:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.504327:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366150016 00000100:00100000:3.0:1782480888.504350:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366150016 00000100:00100000:3.0:1782480888.504461:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:3.0:1782480888.504474:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:10520:x1869066366150016:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782480888.504635:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480888.504729:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5969 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe13 expref: 15 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.504765:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:3.0:1782480888.504773:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480888.504822:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.504840:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.504853:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782480888.506720:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000086c0b59c reply state 0000000007249779 transno 4294967402 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.506743:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1782480888.506924:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:10520:x1869066366150016:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 2447us (6501us total) trans 4294967402 rc 0/0 00000100:00100000:2.0:1782480888.506934:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 125 00010000:00010000:3.0:1782480888.509590:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.509614:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.509623:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.509632:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779bc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480888.509638:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.509727:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.509751:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:3.0:1782480888.509754:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480888.509761:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.509768:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf598c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.513994:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.516261:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366150144 00000100:00100000:0.0:1782480888.516284:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366150144 00000100:00100000:0.0:1782480888.516373:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:0.0:1782480888.516385:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366150144:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1782480888.518267:0:6608:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1782480888.518279:0:6608:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 1782480888 -> 1782480887 00002000:00010000:2.0:1782480888.518282:0:6608:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782480886 00002000:00010000:2.0:1782480888.518284:0:6608:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 1782480888 -> 1782480887 00002000:00010000:2.0:1782480888.518286:0:6608:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1782480888.518415:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366150144:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 2022us (4427us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1782480888.518429:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:2.0:1782480888.525471:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.526145:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366150400 00000100:00100000:3.0:1782480888.526160:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366150400 00000100:00100000:3.0:1782480888.526377:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:3.0:1782480888.526390:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed01aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:10520:x1869066366150400:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1782480888.526497:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.526521:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe05 expref: 15 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.526532:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.526780:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe05 expref: 15 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.526799:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe05 expref: 15 pid: 6840 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480888.526837:0:6840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1869066388184448:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480888.527481:0:6840:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480888.530362:0:6840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f6680 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1869066388184448:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480888.530406:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.533620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480888.534722:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366150528 00000100:00100000:1.0:1782480888.534738:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366150528 00010000:00010000:1.0:1782480888.534806:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe05 expref: 16 pid: 6840 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480888.534877:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:1.0:1782480888.534889:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:2350:x1869066366150528:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480888.534918:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480888.534927:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe05 expref: 16 pid: 6840 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.534944:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe05 expref: 16 pid: 6840 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.535200:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf594d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe05 expref: 16 pid: 6840 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.535235:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:1.0:1782480888.535241:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.535254:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.535283:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.535394:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480888.535486:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:2350:x1869066366150528:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 597us (1879us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480888.535499:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00010000:00010000:3.0:1782480888.542130:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.542153:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.542369:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.542378:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.542387:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.542394:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779bc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480888.542399:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.542407:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.542429:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:2.0:1782480888.542433:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:2.0:1782480888.542438:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.542445:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5993 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.542790:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed01aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:10520:x1869066366150400:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 16394us (17327us total) trans 0 rc -22/-22 00000100:00100000:2.0:1782480888.542802:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 126 00000100:00100000:2.0:1782480888.552283:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.556745:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366150656 00000100:00100000:3.0:1782480888.556769:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366150656 00000100:00100000:2.0:1782480888.559300:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1782480888.559319:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366150656:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1782480888.559411:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 3/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.559439:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 7 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.559450:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:2.0:1782480888.559455:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480888.559462:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 4/1,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.559517:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 7 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.559536:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 7 pid: 6607 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.559569:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6609:1869066388184576:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480888.559836:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df4956c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480888.570781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480888.571149:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366150784 00000100:00100000:1.0:1782480888.571163:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366150784 00010000:00010000:1.0:1782480888.571236:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 8 pid: 6607 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480888.571290:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:1.0:1782480888.571302:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2351:x1869066366150784:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480888.571323:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480888.571357:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 8 pid: 6607 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.571374:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 8 pid: 6607 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.571412:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480888.571417:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480888.571425:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.571459:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.571489:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480888.571588:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2351:x1869066366150784:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 287us (823us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480888.571597:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00010000:00010000:2.0:1782480888.578151:0:6609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000bd43598/0x4776e02a9acf5977 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe21 expref: 7 pid: 6607 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.578189:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6609:1869066388184576:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480888.578235:0:6609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.578280:0:6609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.578287:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.578340:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.578350:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.578359:0:6609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.578367:0:6609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782480888.578372:0:6609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.578381:0:6609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.578407:0:6609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.578426:0:6609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcbfb38c/0x4776e02a9acf599a lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.578580:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366150656:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 19263us (26310us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480888.578594:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:0.0:1782480888.582620:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480888.582852:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366151040 00000100:00100000:2.0:1782480888.582866:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366151040 00000100:00100000:2.0:1782480888.582939:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 127 00000100:00100000:2.0:1782480888.582952:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:10520:x1869066366151040:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782480888.583091:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf59a1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.583115:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf59a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.583130:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf59a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.583425:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.583439:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf595b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe0c expref: 15 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.583448:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.583517:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf595b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe0c expref: 15 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.583535:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf595b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe0c expref: 15 pid: 6840 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.583564:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388184704:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480888.583731:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df4956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480888.593750:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480888.593881:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366151168 00000100:00100000:3.0:1782480888.593895:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366151168 00010000:00010000:3.0:1782480888.593964:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf595b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe0c expref: 16 pid: 6840 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480888.594061:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:3.0:1782480888.594074:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:2350:x1869066366151168:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480888.594094:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480888.594102:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf595b lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe0c expref: 16 pid: 6840 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.594118:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf595b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe0c expref: 16 pid: 6840 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.594173:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:3.0:1782480888.594181:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.594193:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.594203:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.594238:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480888.594315:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9a680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:2350:x1869066366151168:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 243us (580us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480888.594324:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00010000:00010000:2.0:1782480888.595832:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf595b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe0c expref: 15 pid: 6840 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.595866:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388184704:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480888.595898:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.595910:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.595917:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782480888.596226:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:2.0:1782480888.596405:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000001:00080000:2.0:1782480888.596460:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1782480888.598159:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1869066388184832:0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782480888.598287:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480888.598338:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782480888.598404:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388184832 00000100:00100000:2.0:1782480888.598414:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388184832 00000100:00100000:2.0:1782480888.598484:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1782480888.598496:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5804:x1869066388184832:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1782480888.600725:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5804:x1869066388184832:12345-0@lo:1000:mdt00_002.0 Request processed in 2214us (2422us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480888.600747:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782480888.602387:0:5804:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1782480888.602402:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7dfb76d80, transno 4294967303 00000004:00080000:0.0:1782480888.602424:0:5804:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967310 00000004:00080000:0.0:1782480888.602453:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7ef5ddc00, transno 4294967309 00000004:00080000:0.0:1782480888.602457:0:5804:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7ef5dd880, transno 4294967310 00000100:00100000:0.0:1782480888.602493:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1869066388184832:0@lo:1000:mdt00_002.0 00000004:00080000:2.0:1782480888.603228:0:6838:0:(osp_sync.c:1250:osp_sync_process_committed()) lustre-OST0000-osc-MDT0000: 0 changes, 0 in progress, 0 in flight, 3 done 00000001:00080000:0.0:1782480888.604490:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967406 00000100:00100000:0.0:1782480888.608410:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1869066388184960:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1782480888.609743:0:5804:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480888.609834:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dc8060c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480888.610748:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388184960 00000100:00100000:3.0:1782480888.610763:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388184960 00000100:00100000:3.0:1782480888.610849:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782480888.610863:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5804:x1869066388184960:12345-0@lo:1000:mdt00_002.0 00000100:00100000:3.0:1782480888.611369:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5804:x1869066388184960:12345-0@lo:1000:mdt00_002.0 Request processed in 507us (1634us total) trans 4294967312 rc 0/0 00000100:00100000:3.0:1782480888.611380:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782480888.611834:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006ac000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5804:1869066388184960:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1782480888.611904:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.611918:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.611927:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.611934:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2c600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480888.611940:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.611949:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.611986:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:0.0:1782480888.611989:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480888.611995:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.612002:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf59a8 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.612047:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.612079:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.612084:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.612089:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480888.612092:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.612098:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.612109:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:0.0:1782480888.612111:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480888.612121:0:5804:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58f2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdf0 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.612134:0:5804:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58f2 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdf0 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.612145:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdf0 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.612193:0:5804:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58f2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdf0 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480888.612224:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388185088:192.168.201.58@tcp:105: 00000100:00100000:0.0:1782480888.612422:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df4956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480888.619419:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.619815:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388185088:192.168.201.58@tcp:105: 00010000:00010000:0.0:1782480888.619858:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.619872:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf58eb lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.620099:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366151296 00000100:00100000:2.0:1782480888.620109:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366151296 00010000:00010000:1.0:1782480888.620236:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf59af lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620254:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf59af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620269:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf59af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620283:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf59af lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620290:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf59af lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620297:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf59af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620304:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55fc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480888.620309:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf59af lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620339:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf59af lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620354:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:1.0:1782480888.620358:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480888.620363:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf59af lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620368:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf59af lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620380:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf59a1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620386:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf59a1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620392:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf59a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620397:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480888.620400:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf59a1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620405:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf59a1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620412:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:1.0:1782480888.620414:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782480888.620417:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf59a1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.620435:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf59a1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480888.620990:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:10520:x1869066366151040:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 38035us (38381us total) trans 4294967407 rc 0/0 00000100:00100000:1.0:1782480888.621002:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 127 00000020:00080000:1.0:1782480888.621010:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782480888.621782:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480888.621790:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480888.622455:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1782480888.622474:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480888.625440:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:1.0:1782480888.625459:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:10519:x1869066366151296:12345-192.168.201.58@tcp:49:lfs.0 00000100:00100000:1.0:1782480888.625688:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:10519:x1869066366151296:12345-192.168.201.58@tcp:49:lfs.0 Request processed in 232us (6283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480888.625697:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:1.0:1782480888.630005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480888.630077:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.630281:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366151808 00000100:00100000:0.0:1782480888.630294:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366151808 00000100:00100000:0.0:1782480888.630372:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 128 00000100:00100000:0.0:1782480888.630383:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:10519:x1869066366151808:12345-192.168.201.58@tcp:58:lfs.0 00000040:00080000:0.0:1782480888.630939:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:0.0:1782480888.631069:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:10519:x1869066366151808:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 671us (974us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480888.631080:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 128 00000100:00100000:3.0:1782480888.632001:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366151552 00000100:00100000:3.0:1782480888.632013:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366151552 00000100:00100000:3.0:1782480888.632088:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:3.0:1782480888.632098:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:10520:x1869066366151552:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782480888.635479:0:5805:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782480888.635695:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967408 00010000:00010000:3.0:1782480888.635819:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.635841:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.635856:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.635868:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.635875:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.635882:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480888.635912:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782480888.636325:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480888.636335:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.636343:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480888.636348:0:8324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.636358:0:8324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.636384:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff91d7c51d1a00) 00010000:00010000:0.0:1782480888.636387:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782480888.636393:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.636400:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf59b6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.636430:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480888.636433:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480888.636434:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480888.636939:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b65050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:10520:x1869066366151552:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 4833us (6940us total) trans 4294967409 rc 0/0 00000100:00100000:3.0:1782480888.636953:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000020:00080000:3.0:1782480888.636970:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782480888.663757:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480888.663988:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366151936 00000100:00100000:0.0:1782480888.664002:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366151936 00000100:00100000:0.0:1782480888.664092:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 129 00000100:00100000:0.0:1782480888.664104:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:10522:x1869066366151936:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480888.664142:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480888.664171:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf59bd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe28 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.664275:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf59c4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.664294:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf59c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.664308:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf59c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.664325:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf59cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.664350:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf59cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480888.664357:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf59cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.671025:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.671182:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde9 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.671196:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.671265:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde9 expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.671284:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde9 expref: 21 pid: 5804 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480888.671304:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388185216:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480888.671439:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6478840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480888.675907:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388185216:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480888.675974:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480888.676321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480888.676511:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366152192 00000100:00100000:2.0:1782480888.676521:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366152192 00000100:00100000:3.0:1782480888.676765:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:3.0:1782480888.676781:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:5566:x1869066366152192:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782480888.678277:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:5566:x1869066366152192:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 1489us (1946us total) trans 4294967410 rc 0/0 00000100:00100000:3.0:1782480888.678292:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:3.0:1782480888.684915:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480888.685600:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366152320 00000100:00100000:1.0:1782480888.685614:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366152320 00010000:00010000:1.0:1782480888.685844:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde9 expref: 23 pid: 5804 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480888.685903:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:1.0:1782480888.685916:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:2351:x1869066366152320:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480888.685941:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480888.685949:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde9 expref: 23 pid: 5804 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.685995:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde9 expref: 23 pid: 5804 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.686024:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf58dd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fde9 expref: 23 pid: 5804 timeout: 519 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.686045:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:1.0:1782480888.686283:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.686297:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.686307:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480888.686351:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480888.686448:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:2351:x1869066366152320:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 531us (1547us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480888.686459:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00010000:00010000:2.0:1782480888.686629:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.686639:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480888.686805:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1782480888.686811:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480888.686836:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.686852:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.686865:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf59c4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.686871:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf59c4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.686879:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf59c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.686884:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480888.686889:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf59c4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.686897:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf59c4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.686923:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:2.0:1782480888.686926:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480888.686931:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf59c4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.686937:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf59c4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.689648:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf59cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.690198:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf59cb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.690237:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf59cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.690245:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480888.690251:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf59cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.690262:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf59cb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.690285:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff91d7c32f3900) 00010000:00010000:2.0:1782480888.690289:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480888.690295:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf59cb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.690302:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf59cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.690429:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf59bd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe28 expref: 22 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.690447:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe28 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480888.690456:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:2.0:1782480888.690458:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480888.690461:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d000, rc 0) 00000100:00100000:2.0:1782480888.690750:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f98a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:10522:x1869066366151936:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 26644us (27006us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480888.690761:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 129 00010000:00010000:3.0:1782480888.799528:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480889.247150:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388185344:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480889.247264:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480889.249713:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388185344 00000100:00100000:1.0:1782480889.249733:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388185344 00000100:00100000:1.0:1782480889.249825:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1782480889.249837:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1869066388185344:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480889.249874:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1782480889.250914:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1869066388185344:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1071us (3642us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480889.250938:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782480889.253296:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388185344:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480889.322406:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480889.322478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480889.322511:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480889.322590:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366152576 00000100:00100000:0.0:1782480889.322604:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366152576 00000100:00100000:0.0:1782480889.322724:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:0.0:1782480889.322737:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2353:x1869066366152576:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480889.322848:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2353:x1869066366152576:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 114us (459us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480889.322859:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:0.0:1782480889.322893:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366152448 00000100:00100000:0.0:1782480889.322897:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366152448 00000100:00100000:0.0:1782480889.322923:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 297 00000100:00100000:0.0:1782480889.322930:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366152448:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480889.322958:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366152448:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480889.322965:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 297 00000100:00100000:0.0:1782480889.323001:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366152704 00000100:00100000:0.0:1782480889.323004:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366152704 00000100:00100000:0.0:1782480889.323042:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 158 00000100:00100000:0.0:1782480889.323050:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366152704:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480889.323084:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366152704:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 36us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480889.323104:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 158 00000100:00080000:3.0:1782480889.323312:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1782480889.323319:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:0.0:1782480889.632930:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480889.632945:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480889.633068:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:0.0:1782480889.633078:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480889.633268:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388185472:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782480889.633421:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c4a123c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480889.646974:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480889.647038:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366152832 00000100:00100000:0.0:1782480889.647050:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366152832 00000100:00100000:0.0:1782480889.647139:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00100000:0.0:1782480889.647152:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:10533:x1869066366152832:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782480889.647212:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782480889.647366:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:10533:x1869066366152832:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 215us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480889.647374:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 130 00000100:00080000:0.0:1782480889.647401:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480889.648392:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd500 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388185472:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782480889.656641:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480889.656835:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366153088 00000100:00100000:3.0:1782480889.656849:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366153088 00000100:00100000:3.0:1782480889.656931:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:3.0:1782480889.656944:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:10533:x1869066366153088:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480889.656971:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480889.657000:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf59d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe2f expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480889.657295:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf59e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480889.657315:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf59e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480889.657330:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf59e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480889.657346:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1782480889.657530:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf59d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe2f expref: 24 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480889.657554:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf59e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe2f expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480889.657589:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480889.657592:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480889.657597:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a600, rc 0) 00000100:00100000:3.0:1782480889.659188:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:10533:x1869066366153088:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 2231us (2545us total) trans 4294967411 rc 0/0 00000100:00100000:3.0:1782480889.659214:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 131 00000100:00100000:0.0:1782480889.672290:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480889.672347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480889.672482:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366153472 00000100:00100000:2.0:1782480889.672495:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366153472 00000100:00100000:2.0:1782480889.672571:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 132 00000100:00100000:2.0:1782480889.672584:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:10533:x1869066366153472:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782480889.672735:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf59ee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480889.672771:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf59ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480889.672809:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf59ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480889.673240:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf59ee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480889.673250:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf59ee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480889.673258:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf59ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480889.673264:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480889.673270:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf59ee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480889.673279:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf59ee lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480889.673294:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:2.0:1782480889.673297:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782480889.673301:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf59ee lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480889.673306:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf59ee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480889.673483:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:10533:x1869066366153472:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 897us (1130us total) trans 4294967412 rc 0/0 00000100:00100000:2.0:1782480889.673493:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 132 00000040:00080000:2.0:1782480889.673837:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782480889.673843:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782480889.674402:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1782480889.674415:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782480889.675419:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366153216 00000100:00100000:3.0:1782480889.675435:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366153216 00000100:00100000:3.0:1782480889.675524:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:3.0:1782480889.675535:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:2351:x1869066366153216:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480889.675555:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480889.675585:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf59e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe2f expref: 24 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480889.675607:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480889.675612:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480889.675706:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:2351:x1869066366153216:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 172us (3429us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480889.675713:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:0.0:1782480889.681634:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480889.681924:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366153728 00000100:00100000:2.0:1782480889.681938:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366153728 00000100:00100000:2.0:1782480889.682023:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:2.0:1782480889.682167:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:10533:x1869066366153728:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1782480889.683283:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:10533:x1869066366153728:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1238us (1654us total) trans 4294967413 rc 0/0 00000100:00100000:2.0:1782480889.683301:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00000040:00080000:3.0:1782480889.752141:0:11985:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782480889.752154:0:11985:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480889.752222:0:11985:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1782480889.752231:0:11985:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1782480889.841211:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480889.992263:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480889.992348:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366153984 00000100:00100000:1.0:1782480889.992364:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366153984 00000100:00100000:1.0:1782480889.992482:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00100000:1.0:1782480889.992494:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:10547:x1869066366153984:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782480889.992539:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480889.992568:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf59f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe36 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.992716:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf59fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.992734:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf59fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.992747:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf59fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480889.992762:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1782480889.992927:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf59f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe36 expref: 27 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.992950:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf59fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe36 expref: 26 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480889.992961:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:1.0:1782480889.992983:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782480889.992988:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55f000, rc 0) 00000100:00100000:1.0:1782480889.993073:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:10547:x1869066366153984:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 580us (816us total) trans 4294967414 rc 0/0 00000100:00100000:1.0:1782480889.993081:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 133 00000100:00100000:2.0:1782480890.016236:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480890.027509:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366154112 00000100:00100000:1.0:1782480890.027527:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366154112 00000100:00100000:1.0:1782480890.027603:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:1.0:1782480890.027613:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:10547:x1869066366154112:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:1.0:1782480890.027738:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5a0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480890.027757:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480890.027770:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480890.027799:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5a0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480890.027807:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5a0a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480890.027815:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5a0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480890.027822:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ea00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480890.027827:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5a0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480890.027854:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5a0a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480890.027869:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:1.0:1782480890.027873:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480890.027880:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5a0a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480890.027888:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5a0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480890.028022:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb74380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:10547:x1869066366154112:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 409us (11795us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480890.028029:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 134 00000100:00100000:0.0:1782480890.177331:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480890.177446:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366154240 00000100:00100000:2.0:1782480890.177461:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366154240 00000100:00100000:2.0:1782480890.177620:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:2.0:1782480890.177634:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366154240:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:2.0:1782480890.177735:0:6607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480890.177759:0:6607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ee04902a/0x4776e02a9acf5a11 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe3d expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480890.177787:0:6607:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3e7ff7, atime: 0x6a3e7ff6, ctime: 0x6a3e7ff7, blocks: 0xb 00010000:00010000:2.0:1782480890.177807:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=420s v=(0 0) 00010000:00010000:2.0:1782480890.177811:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480890.177820:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ee04902a/0x4776e02a9acf5a11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe3d expref: 7 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480890.177838:0:6607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ee04902a/0x4776e02a9acf5a11 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe3d expref: 7 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480890.177879:0:6607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d800, rc 0) 00000100:00100000:2.0:1782480890.177953:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366154240:12345-192.168.201.58@tcp:101:cat.0 Request processed in 323us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480890.177960:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00080000:0.0:1782480890.181294:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480890.181767:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480890.182075:0:6614:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366154368 00000100:00100000:3.0:1782480890.182102:0:6614:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366154368 00002000:00100000:3.0:1782480890.182196:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91d7f4f9bb80 x1869066366154368/t0(0) o3->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:646/0 lens 488/0 e 0 to 0 dl 1782480901 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480890.182206:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7f4f9bb80 with x1869066366154368 ext(0->4095) 00002000:00010000:3.0:1782480890.182212:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7f4f9bb80 00000100:00100000:3.0:1782480890.182247:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:3.0:1782480890.182257:0:6614:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366154368:12345-192.168.201.58@tcp:3:cat.0 00000100:00100000:3.0:1782480890.182614:0:6614:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366154368:12345-192.168.201.58@tcp:3:cat.0 Request processed in 357us (851us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1782480890.182621:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00002000:00100000:3.0:1782480890.182630:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->4095) req@ffff91d7f4f9bb80 x1869066366154368/t0(0) o3->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:646/0 lens 488/4536 e 0 to 0 dl 1782480901 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480890.182637:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7f4f9bb80 with x1869066366154368 ext(0->4095) 00002000:00010000:3.0:1782480890.182654:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7f4f9bb80 00000001:00080000:0.0:1782480890.377165:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967304 is committed 00000001:00080000:0.0:1782480890.377198:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00010000:00010000:0.0:1782480890.850740:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782480891.749485:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480891.749495:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480891.749533:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1782480891.749540:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480891.807259:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782480891.807520:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388185728:0@lo:400:kworker.0 00000100:00100000:0.0:1782480891.807596:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480891.807716:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388185600:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480891.807748:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480891.807835:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388185600 00000100:00100000:1.0:1782480891.807843:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388185600 00000100:00100000:1.0:1782480891.807909:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782480891.807919:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388185600:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480891.807956:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480891.808016:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388185600:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480891.808025:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1782480891.808076:0:3311:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:1.0:1782480891.808095:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:1.0:1782480891.808116:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7ef5dd500, transno 4294967304 00000100:00100000:1.0:1782480891.808137:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388185600:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782480891.808590:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480891.808731:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388185856:0@lo:400:kworker.0 00000100:00100000:2.0:1782480891.808769:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480891.808794:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480891.808812:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388185984:0@lo:400:kworker.0 00000100:00100000:2.0:1782480891.808837:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480891.808868:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388185856 00000100:00100000:2.0:1782480891.808873:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388185856 00000100:00100000:2.0:1782480891.808906:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388185984 00000100:00100000:2.0:1782480891.808909:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388185984 00000100:00100000:2.0:1782480891.808935:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782480891.808943:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388185856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480891.808984:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388185856:12345-0@lo:400:kworker.0 Request processed in 42us (214us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480891.808991:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:2.0:1782480891.809174:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1782480891.809182:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388185984:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480891.809212:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388185984:12345-0@lo:400:kworker.0 Request processed in 32us (375us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480891.809217:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00080000:2.0:1782480891.809238:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480891.809273:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388185984:0@lo:400:kworker.0 00000100:00100000:2.0:1782480891.809284:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388185856:0@lo:400:kworker.0 00000100:00100000:0.0:1782480891.809356:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388186112:0@lo:400:kworker.0 00000100:00100000:0.0:1782480891.809387:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480891.809414:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480891.809420:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388186240:0@lo:400:kworker.0 00000100:00100000:0.0:1782480891.809442:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480891.809502:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388186112 00000100:00100000:2.0:1782480891.809506:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388186112 00000100:00100000:2.0:1782480891.809545:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782480891.809551:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388186112:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480891.809587:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388186112:12345-0@lo:400:kworker.0 Request processed in 36us (199us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480891.809593:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1782480891.809621:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388186112:0@lo:400:kworker.0 00000100:00100000:2.0:1782480891.809636:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388186240 00000100:00100000:2.0:1782480891.809639:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388186240 00000100:00100000:2.0:1782480891.809681:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782480891.809687:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388186240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480891.809719:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388186240:12345-0@lo:400:kworker.0 Request processed in 32us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480891.809724:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1782480891.809748:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388186240:0@lo:400:kworker.0 00000100:00080000:0.0:1782480891.809808:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480891.809812:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480891.809971:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388185728 00000100:00100000:3.0:1782480891.809976:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388185728 00000100:00100000:3.0:1782480891.810172:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 298 00000100:00100000:3.0:1782480891.810180:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388185728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480891.810224:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388185728:12345-0@lo:400:kworker.0 Request processed in 46us (2629us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480891.810230:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 298 00000100:00100000:1.0:1782480891.810288:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfb76d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388185728:0@lo:400:kworker.0 00010000:00010000:3.0:1782480891.871072:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480892.896201:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782480893.472137:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967407 is committed 00000020:00080000:2.0:1782480893.472155:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d7dc806540 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1782480893.472162:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c7c83b00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d7dc806840 00000020:00080000:2.0:1782480893.472165:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c7c83700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d7c4afb000 00000001:00080000:2.0:1782480893.472262:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1782480893.472271:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000020:00080000:2.0:1782480893.472352:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1782480893.472689:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00010000:00010000:3.0:1782480893.929910:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782480893.956062:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967311 is committed 00000001:00080000:3.0:1782480893.956086:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967312 is committed 00000100:00100000:2.0:1782480894.366856:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480894.366889:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388186368:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480894.367009:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480894.367122:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388186368 00000100:00100000:2.0:1782480894.367133:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388186368 00000100:00100000:2.0:1782480894.367209:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782480894.367220:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388186368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480894.367269:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480894.367324:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388186368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 105us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480894.367332:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782480894.367386:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:2.0:1782480894.367393:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967312 committed transno 4294967312 00000100:00100000:2.0:1782480894.367429:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388186368:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782480894.368074:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480894.448201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480894.448727:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480894.448784:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480894.448805:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480894.448826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480894.448869:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366154752 00000100:00100000:3.0:1782480894.448882:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366154752 00000100:00100000:1.0:1782480894.449057:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366154496 00000100:00100000:1.0:1782480894.449062:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366154496 00000100:00100000:1.0:1782480894.449117:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 299 00000100:00100000:1.0:1782480894.449130:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366154496:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480894.449246:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366154496:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 118us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480894.449255:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 299 00000100:00100000:3.0:1782480894.450466:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366154880 00000100:00100000:3.0:1782480894.450483:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366154880 00000100:00100000:3.0:1782480894.450634:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:3.0:1782480894.450647:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366154752:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480894.450762:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2353:x1869066366154752:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 119us (2037us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.450769:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:3.0:1782480894.450788:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:3.0:1782480894.450795:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366154880:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480894.450821:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366154880:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (1994us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.450828:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:3.0:1782480894.450857:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366155008 00000100:00100000:3.0:1782480894.450862:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366155008 00000100:00100000:3.0:1782480894.450894:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366154624 00000100:00100000:3.0:1782480894.450898:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366154624 00000100:00100000:3.0:1782480894.450920:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00100000:3.0:1782480894.450926:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366155008:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:2.0:1782480894.451164:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782480894.451170:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480894.451173:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480894.451199:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 163 00000100:00100000:2.0:1782480894.451209:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:2353:x1869066366154624:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480894.453378:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2353:x1869066366155008:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 2433us (4574us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480894.453398:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00100000:2.0:1782480894.460437:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:2353:x1869066366154624:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 9211us (11611us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480894.460459:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 163 00010000:00010000:3.0:1782480894.942896:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480895.967128:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480896.783935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480896.784710:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366155136 00000100:00100000:2.0:1782480896.784726:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366155136 00000100:00100000:2.0:1782480896.784836:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:2.0:1782480896.784869:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:10199:x1869066366155136:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 00000100:00080000:0.0:1782480896.785044:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480896.785504:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:10199:x1869066366155136:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 Request processed in 636us (1582us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480896.785513:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 135 00000100:00100000:2.0:1782480896.797025:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480896.797432:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366155392 00000100:00100000:1.0:1782480896.797446:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366155392 00000100:00100000:1.0:1782480896.797540:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:1.0:1782480896.797553:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:10199:x1869066366155392:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1782480896.799040:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:10199:x1869066366155392:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1352us (1895us total) trans 4294967415 rc 0/0 00000100:00100000:1.0:1782480896.799056:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:2.0:1782480896.927182:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388186496:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480896.927307:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480896.927485:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388186624:0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.927544:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480896.927602:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388187136:0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.927630:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480896.927688:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782480896.927694:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388186752:0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.927717:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480896.927733:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388187264:0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.927756:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480896.927794:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388187264 00000100:00100000:0.0:1782480896.927803:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388187264 00000100:00100000:0.0:1782480896.928035:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1782480896.928049:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388187264:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.928131:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388187264:12345-0@lo:400:kworker.0 Request processed in 86us (372us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480896.928139:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00080000:0.0:1782480896.928168:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480896.928205:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388187264:0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.928257:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388187136 00000100:00100000:0.0:1782480896.928260:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388187136 00000100:00100000:0.0:1782480896.928295:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388186752 00000100:00100000:0.0:1782480896.928298:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388186752 00000100:00100000:0.0:1782480896.928319:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782480896.928326:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388187136:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.928365:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388187136:12345-0@lo:400:kworker.0 Request processed in 40us (734us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480896.928371:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:0.0:1782480896.928383:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:0.0:1782480896.928388:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388186752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.928415:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388186752:12345-0@lo:400:kworker.0 Request processed in 26us (696us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480896.928420:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00080000:0.0:1782480896.928436:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480896.928509:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388186880:0@lo:400:kworker.0 00000100:00100000:3.0:1782480896.928560:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480896.928566:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388187008:0@lo:400:kworker.0 00000100:00100000:3.0:1782480896.928593:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388186624 00000100:00100000:2.0:1782480896.928593:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480896.928597:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388186624 00000100:00100000:2.0:1782480896.928622:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388186880 00000100:00100000:2.0:1782480896.928625:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388186880 00000100:00100000:3.0:1782480896.928626:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 300 00000100:00100000:3.0:1782480896.928632:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388186624:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480896.928651:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782480896.928656:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388186880:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480896.928679:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3310:x1869066388186624:12345-0@lo:400:kworker.0 Request processed in 48us (1135us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480896.928686:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 300 00000100:00100000:2.0:1782480896.928704:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388186880:12345-0@lo:400:kworker.0 Request processed in 48us (144us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480896.928710:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:2.0:1782480896.928729:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388187008 00000100:00100000:2.0:1782480896.928732:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388187008 00000100:00100000:2.0:1782480896.928758:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782480896.928764:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388187008:12345-0@lo:400:kworker.0 00000100:00080000:3.0:1782480896.928766:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782480896.928769:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480896.928795:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388186880:0@lo:400:kworker.0 00000100:00100000:2.0:1782480896.928799:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388187008:12345-0@lo:400:kworker.0 Request processed in 36us (206us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480896.928805:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782480896.928826:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388187008:0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.928947:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388186752:0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.928960:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388186624:0@lo:400:kworker.0 00000100:00100000:0.0:1782480896.928971:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388187136:0@lo:400:kworker.0 00000100:00100000:1.0:1782480896.934322:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388186496 00000100:00100000:1.0:1782480896.934345:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388186496 00000100:00100000:1.0:1782480896.934448:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1782480896.934461:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388186496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480896.934770:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480896.934988:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388186496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 528us (7680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480896.935016:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782480896.935102:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4f99f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388186496:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480896.992042:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480897.032189:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480897.032340:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366155520 00000100:00100000:2.0:1782480897.032368:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366155520 00000100:00100000:2.0:1782480897.032473:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00100000:2.0:1782480897.032486:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:10999:x1869066366155520:12345-192.168.201.58@tcp:101:lsof.0 00010000:00010000:2.0:1782480897.032507:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480897.032530:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5a18 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe44 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480897.032607:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480897.032623:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480897.032637:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480897.032897:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782480897.033417:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480897.033559:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480897.033594:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5a18 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe44 expref: 7 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480897.033615:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe44 expref: 6 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480897.033626:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:2.0:1782480897.033629:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480897.033633:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d400, rc 0) 00000100:00100000:2.0:1782480897.033764:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f99180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:10999:x1869066366155520:12345-192.168.201.58@tcp:101:lsof.0 Request processed in 1280us (1583us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480897.033773:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 136 00000100:00080000:3.0:1782480897.033918:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782480898.016408:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782480898.542519:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00000020:00080000:2.0:1782480898.542556:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:3.0:1782480898.542725:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1782480898.542743:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00010000:00010000:0.0:1782480899.039241:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480899.490117:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388187392:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480899.490235:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480899.490438:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388187392 00000100:00100000:1.0:1782480899.490449:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388187392 00000100:00100000:1.0:1782480899.490530:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782480899.490541:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388187392:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480899.490592:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480899.490655:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388187392:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480899.490696:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1782480899.490756:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388187392:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782480899.491359:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480899.564070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480899.564131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480899.564179:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480899.564228:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366156160 00000100:00100000:3.0:1782480899.564263:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366156160 00000100:00100000:3.0:1782480899.564348:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 167 00000100:00100000:3.0:1782480899.564360:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2350:x1869066366156160:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480899.564476:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2350:x1869066366156160:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 118us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480899.564702:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366155648 00000100:00100000:0.0:1782480899.564707:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366155648 00000100:00100000:0.0:1782480899.564747:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 301 00000100:00100000:0.0:1782480899.564755:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366155648:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480899.564786:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10e9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366155648:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 33us (732us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480899.564794:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 301 00000100:00080000:0.0:1782480899.564895:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480899.565977:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366155904 00000100:00100000:2.0:1782480899.565991:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366155904 00000100:00100000:2.0:1782480899.566083:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:2.0:1782480899.566093:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366155904:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480899.566181:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 167 00000100:00080000:0.0:1782480899.567884:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480899.568710:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366155904:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 2604us (4563us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480899.568727:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:3.0:1782480899.568911:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480899.569079:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480899.569231:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366155776 00000100:00100000:0.0:1782480899.569244:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366155776 00000100:00100000:0.0:1782480899.569326:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 168 00000100:00100000:0.0:1782480899.569338:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:2350:x1869066366155776:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480899.569451:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:2350:x1869066366155776:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 100us (526us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480899.569459:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 168 00000100:00100000:2.0:1782480899.569927:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366156032 00000100:00100000:2.0:1782480899.569933:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366156032 00000100:00100000:2.0:1782480899.569992:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:2.0:1782480899.570001:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366156032:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480899.570050:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366156032:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 51us (971us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480899.570057:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00080000:3.0:1782480899.570373:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480899.570379:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782480900.063044:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480901.087150:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1782480901.983236:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1782480901.983250:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1782480901.983928:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:3.0:1782480901.983945:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782480902.052397:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388187520:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.052516:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480902.052581:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388188032:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.052615:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480902.052649:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480902.052655:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388187904:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.052708:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480902.052762:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388187648:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.052790:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480902.052811:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388188160:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.053135:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480902.053166:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480902.053173:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388187776:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.053198:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480902.053240:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388187520 00000100:00100000:2.0:1782480902.053250:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388187520 00000100:00100000:2.0:1782480902.053306:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1782480902.053317:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388187520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.053380:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10ea850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388187520:12345-0@lo:400:kworker.0 Request processed in 65us (865us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480902.053388:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 302 00000100:00100000:2.0:1782480902.053436:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388188032 00000100:00100000:2.0:1782480902.053440:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388188032 00000100:00100000:2.0:1782480902.053481:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388187648 00000100:00100000:2.0:1782480902.053483:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388187648 00000100:00100000:2.0:1782480902.053494:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388187776 00000100:00100000:2.0:1782480902.053496:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388187776 00000100:00100000:2.0:1782480902.053510:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782480902.053516:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388188032:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.053551:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388188032:12345-0@lo:400:kworker.0 Request processed in 35us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480902.053558:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 169 00000100:00100000:2.0:1782480902.053569:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1782480902.053575:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388187648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.053623:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388187648:12345-0@lo:400:kworker.0 Request processed in 47us (831us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480902.053630:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1782480902.053642:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782480902.053648:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388187776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.053707:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388187776:12345-0@lo:400:kworker.0 Request processed in 59us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480902.053713:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1782480902.053738:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388187904 00000100:00100000:2.0:1782480902.053741:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388187904 00000100:00100000:2.0:1782480902.053768:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388188160 00000100:00100000:2.0:1782480902.053771:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388188160 00000100:00100000:2.0:1782480902.053795:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1782480902.053801:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388187904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480902.053952:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:0.0:1782480902.053962:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388188160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480902.054013:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388188160:12345-0@lo:400:kworker.0 Request processed in 54us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480902.054020:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1782480902.055400:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388187904:12345-0@lo:400:kworker.0 Request processed in 1589us (2680us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480902.055414:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:2.0:1782480902.055474:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1782480902.055481:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480902.055485:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480902.055554:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388187776:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.055570:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388187648:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.055584:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388188160:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.055635:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dd880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388187904:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.055648:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388187520:0@lo:400:kworker.0 00000100:00100000:2.0:1782480902.056967:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ddc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388188032:0@lo:400:kworker.0 00000100:00100000:0.0:1782480902.070853:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480902.070884:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388188288:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480902.070991:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480902.071194:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388188288 00000100:00100000:1.0:1782480902.071207:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388188288 00000100:00100000:1.0:1782480902.071284:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782480902.071297:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388188288:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480902.071351:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480902.071413:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388188288:12345-0@lo:13:osp-pre-1-0.0 Request processed in 118us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480902.071421:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1782480902.071495:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388188288:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1782480902.111270:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782480902.641133:0:12190:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 09:35:00 (1782480900) 00010000:00010000:3.0:1782480903.135164:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480904.159228:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480904.174377:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480904.192080:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366156416 00000100:00100000:2.0:1782480904.192107:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366156416 00000100:00080000:2.0:1782480904.192732:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480904.194632:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:3.0:1782480904.194692:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:11264:x1869066366156416:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480904.194726:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480904.194756:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe4b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.195497:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5a2d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.195544:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5a2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.195559:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5a2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.195951:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5a34 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.195962:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5a34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.195971:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5a34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.201736:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.201768:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.201784:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480904.201802:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:3.0:1782480904.206654:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5a2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.206694:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5a2d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.206703:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5a2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.206729:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480904.206735:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5a2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.206744:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5a2d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.206766:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d7c32f3a00) 00010000:00010000:3.0:1782480904.206769:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480904.206774:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5a2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.207342:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5a2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.207364:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5a34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.207371:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5a34 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.207378:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5a34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.207383:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480904.207386:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5a34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.207392:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5a34 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.207414:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91d7c51d1300) 00010000:00010000:3.0:1782480904.207416:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480904.207420:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5a34 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.207427:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5a34 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.215174:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe4b expref: 16 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.215216:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe4b expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.215227:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:3.0:1782480904.215230:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480904.215234:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a200, rc 0) 00000100:00100000:3.0:1782480904.215328:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:11264:x1869066366156416:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 20675us (40967us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1782480904.215339:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 137 00000100:00100000:1.0:1782480904.229042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480904.229108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480904.229213:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366156544 00000100:00100000:3.0:1782480904.229227:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366156544 00000100:00100000:3.0:1782480904.229316:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1782480904.229329:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:2352:x1869066366156544:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480904.229354:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480904.229388:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe4b expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480904.229443:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:3.0:1782480904.229452:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480904.229537:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10f0050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:2352:x1869066366156544:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 210us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480904.229545:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1782480904.229982:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366156672 00000100:00100000:2.0:1782480904.229988:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366156672 00000100:00100000:2.0:1782480904.230028:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:2.0:1782480904.230037:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:11264:x1869066366156672:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782480904.230127:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f98700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:11264:x1869066366156672:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 Request processed in 92us (1102us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480904.230134:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 138 00000100:00100000:3.0:1782480904.610913:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388188416:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480904.611056:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480904.612998:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388188416 00000100:00100000:2.0:1782480904.613022:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388188416 00000100:00100000:2.0:1782480904.613144:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782480904.613158:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388188416:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480904.613222:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480904.613368:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388188416:12345-0@lo:13:osp-pre-0-0.0 Request processed in 212us (2311us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480904.613377:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1782480904.613479:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388188416:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782480904.613845:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480904.683615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480904.684841:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366156800 00000100:00100000:3.0:1782480904.684860:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366156800 00000100:00100000:3.0:1782480904.685118:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 303 00000100:00100000:3.0:1782480904.685132:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2351:x1869066366156800:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480904.685254:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10eb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2351:x1869066366156800:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 124us (1655us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480904.685263:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 303 00000100:00100000:0.0:1782480904.685465:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480904.686055:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480904.686080:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480904.686105:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480904.686439:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366157312 00000100:00100000:3.0:1782480904.686449:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366157312 00000100:00100000:3.0:1782480904.686508:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366156928 00000100:00100000:3.0:1782480904.686511:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366156928 00000100:00100000:3.0:1782480904.686533:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 172 00000100:00100000:3.0:1782480904.686541:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2351:x1869066366157312:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480904.686615:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2351:x1869066366157312:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 74us (561us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480904.686623:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 172 00000100:00100000:3.0:1782480904.686640:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 173 00000100:00100000:3.0:1782480904.686687:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:2351:x1869066366156928:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480904.686719:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:2351:x1869066366156928:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 33us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480904.686725:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 173 00000100:00080000:3.0:1782480904.686746:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480904.702903:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366157056 00000100:00100000:2.0:1782480904.702945:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366157056 00000100:00100000:2.0:1782480904.703064:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366157184 00000100:00100000:2.0:1782480904.703068:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366157184 00000100:00100000:2.0:1782480904.703113:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:2.0:1782480904.703125:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366157056:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480904.703273:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4cb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366157056:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 149us (17806us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480904.703281:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:2.0:1782480904.703306:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:2.0:1782480904.703312:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2351:x1869066366157184:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480904.703338:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2351:x1869066366157184:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (17233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480904.703345:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00080000:3.0:1782480904.705569:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782480904.705585:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:1.0:1782480905.058255:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480905.058286:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480905.059019:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 1 00000040:00080000:1.0:1782480905.059033:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1782480905.183903:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480906.228607:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480907.101082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.103645:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366157440 00000100:00100000:0.0:1782480907.103675:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366157440 00000100:00100000:0.0:1782480907.103763:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 139 00000100:00100000:0.0:1782480907.103775:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:11307:x1869066366157440:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480907.103797:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480907.103829:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5a49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe52 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.103907:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.103921:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.103933:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.103950:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5a57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.103958:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.103965:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104592:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104603:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104610:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104616:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480907.104621:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104629:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104642:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:0.0:1782480907.104645:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480907.104650:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104655:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104695:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5a57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104701:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5a57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104707:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104718:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480907.104721:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5a57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104935:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5a57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104945:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91d7c32f3300) 00010000:00010000:0.0:1782480907.104947:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480907.104950:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5a57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104956:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5a57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.104994:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5a49 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe52 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.105004:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:0.0:1782480907.105006:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480907.105010:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5a49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe52 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.105020:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b800, rc 0) 00000100:00100000:0.0:1782480907.105567:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f98000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:11307:x1869066366157440:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1792us (4492us total) trans 0 rc 301/301 00000100:00100000:0.0:1782480907.105577:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 139 00000100:00080000:0.0:1782480907.105611:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480907.110453:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480907.110517:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366157696 00000100:00100000:3.0:1782480907.110528:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366157696 00000100:00100000:3.0:1782480907.110591:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 140 00000100:00100000:3.0:1782480907.110602:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:11307:x1869066366157696:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:3.0:1782480907.110689:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480907.110720:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f400/0x4776e02a9acf53c7 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc8b expref: 14 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.110754:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:3.0:1782480907.110761:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480907.113279:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.113305:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe44 expref: 5 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.113314:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.113355:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe44 expref: 5 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.113381:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe44 expref: 5 pid: 5804 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480907.113398:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388188544:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480907.114741:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495840 going to sleep for 11 seconds 00000100:00100000:3.0:1782480907.149201:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f6a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388188544:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480907.149239:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.150701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.153373:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366157824 00000100:00100000:0.0:1782480907.153394:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366157824 00010000:00010000:0.0:1782480907.153493:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe44 expref: 6 pid: 5804 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480907.153534:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:0.0:1782480907.153542:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2351:x1869066366157824:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480907.153561:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480907.153569:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe44 expref: 6 pid: 5804 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.153582:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe44 expref: 6 pid: 5804 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.153604:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5a1f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe44 expref: 6 pid: 5804 timeout: 537 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.153621:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:0.0:1782480907.153627:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.153636:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.153643:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.153689:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480907.153761:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea2300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2351:x1869066366157824:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 218us (3068us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.153785:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00080000:2.0:1782480907.154441:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480907.178116:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388189056:0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.179951:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.180021:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1782480907.180035:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388188672:0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.180095:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.180933:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388189184:0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.180980:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.181013:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388188800:0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.181039:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.181056:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388189312:0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.181080:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.181655:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480907.181701:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388188928:0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.181711:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388189184 00000100:00100000:1.0:1782480907.181718:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388189184 00000100:00100000:2.0:1782480907.181743:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.181760:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480907.181766:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388189440:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480907.181766:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388188800 00000100:00100000:1.0:1782480907.181769:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388188800 00000100:00100000:1.0:1782480907.181782:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388188928 00000100:00100000:1.0:1782480907.181785:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388188928 00000100:00100000:2.0:1782480907.181788:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480907.181830:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388189056 00000100:00100000:2.0:1782480907.181833:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388189056 00000100:00100000:2.0:1782480907.181859:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388189312 00000100:00100000:2.0:1782480907.181863:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388189312 00000100:00100000:2.0:1782480907.181895:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782480907.181903:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388189056:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.181955:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388189056:12345-0@lo:400:kworker.0 Request processed in 53us (2012us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.181963:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1782480907.181979:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782480907.181985:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388189312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.182016:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388189312:12345-0@lo:400:kworker.0 Request processed in 31us (935us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.182023:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:2.0:1782480907.182041:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388188672 00000100:00100000:2.0:1782480907.182045:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388188672 00000100:00100000:2.0:1782480907.182072:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1782480907.182078:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388188672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.182120:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388188672:12345-0@lo:400:kworker.0 Request processed in 42us (2025us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.182126:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 304 00000100:00100000:2.0:1782480907.182161:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388189440 00000100:00100000:2.0:1782480907.182170:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388189440 00000100:00100000:2.0:1782480907.182195:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1782480907.182201:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388189440:12345-0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480907.182221:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00000024:2.0:1782480907.182229:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00010000:00010000:3.0:1782480907.182233:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.182261:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.182261:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddfb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388189440:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (470us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.182268:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00010000:00010000:3.0:1782480907.182275:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.182286:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.182318:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388188672:0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.182335:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388189056:0@lo:400:kworker.0 00000100:00100000:2.0:1782480907.182368:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4f98e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388189440:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782480907.182376:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388189312:0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.183347:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:1.0:1782480907.183363:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388189184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.183428:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388189184:12345-0@lo:400:kworker.0 Request processed in 72us (2447us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.183436:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1782480907.183542:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388189184:0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.184996:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1782480907.185010:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388188800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.185693:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388188800:12345-0@lo:400:kworker.0 Request processed in 684us (4648us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.185703:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:1.0:1782480907.185726:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782480907.185736:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388188928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.185769:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388188928:12345-0@lo:400:kworker.0 Request processed in 36us (4025us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.185774:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:1.0:1782480907.190194:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388188928:0@lo:400:kworker.0 00000100:00100000:1.0:1782480907.190215:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388188800:0@lo:400:kworker.0 00000100:00080000:1.0:1782480907.190263:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480907.190269:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480907.190272:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1782480907.191012:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1782480907.192408:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.192425:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.192504:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.192510:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480907.192515:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.192522:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.192542:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c8d19800) 00010000:00010000:3.0:1782480907.192545:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480907.192551:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.192557:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5a5e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480907.192581:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008c65dde6 reply state 00000000ea1bed97 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480907.192592:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480907.192755:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:11307:x1869066366157696:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 82149us (82307us total) trans 4294967417 rc 0/0 00000100:00100000:3.0:1782480907.192764:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 140 00010000:00010000:1.0:1782480907.209430:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.209450:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.209458:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.209465:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480907.209470:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.209477:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.209496:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91d7c51d1300) 00010000:00010000:1.0:1782480907.209500:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480907.209505:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.209511:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5a65 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.235551:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480907.301936:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.303465:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366157952 00000100:00100000:0.0:1782480907.303481:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366157952 00000100:00100000:0.0:1782480907.303549:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 141 00000100:00100000:0.0:1782480907.303570:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:11315:x1869066366157952:12345-192.168.201.58@tcp:101:lctl.0 00010000:00010000:0.0:1782480907.303596:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480907.303621:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe59 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.305386:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5a73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.305414:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5a73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.305429:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5a73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480907.305508:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1782480907.305512:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480907.305548:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5a73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.307873:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5a6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe59 expref: 16 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.307918:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5a73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe59 expref: 15 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.307953:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3300) 00010000:00010000:0.0:1782480907.307957:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480907.307961:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b600, rc 0) 00000100:00100000:0.0:1782480907.308064:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:11315:x1869066366157952:12345-192.168.201.58@tcp:101:lctl.0 Request processed in 4495us (6136us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.308076:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 141 00000100:00100000:2.0:1782480907.454507:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480907.454593:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366158080 00000100:00100000:1.0:1782480907.454605:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366158080 00000100:00100000:1.0:1782480907.454706:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 142 00000100:00100000:1.0:1782480907.454719:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+15:11321:x1869066366158080:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1782480907.454761:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480907.454803:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5a7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe60 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.454892:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5a81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.454908:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5a81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.454919:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5a81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.454931:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.454937:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.454942:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455076:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf5a8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455084:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf5a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455091:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf5a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480907.455126:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:1.0:1782480907.455136:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480907.455166:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf5a8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455178:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5a81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455184:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5a81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455191:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5a81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455196:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480907.455200:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5a81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455208:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5a81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455221:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3300) 00010000:00010000:1.0:1782480907.455224:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480907.455228:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5a81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455235:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5a81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455248:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455255:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455271:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455275:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ee00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480907.455278:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455284:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455291:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff91d7c8d19600) 00010000:00010000:1.0:1782480907.455293:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480907.455296:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455301:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455331:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5a7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe60 expref: 17 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455344:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf5a8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe60 expref: 16 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.455351:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:1.0:1782480907.455353:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:1.0:1782480907.455355:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55f800, rc 0) 00000100:00100000:1.0:1782480907.455422:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:11321:x1869066366158080:12345-192.168.201.58@tcp:101:bash.0 Request processed in 705us (925us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480907.456405:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 142 00000100:00100000:3.0:1782480907.472872:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480907.474584:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366158336 00000100:00100000:1.0:1782480907.474600:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366158336 00000100:00100000:1.0:1782480907.474801:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 143 00000100:00100000:1.0:1782480907.474813:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+16:11321:x1869066366158336:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1782480907.474839:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480907.474863:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5a96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe67 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.475048:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.475067:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.475080:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.475118:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.475127:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.475135:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480907.475797:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:1.0:1782480907.475994:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476015:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476023:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476065:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476073:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476079:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476086:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ee00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480907.476091:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476099:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476112:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:1.0:1782480907.476115:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480907.476120:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476126:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5a9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782480907.476139:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000005ebca13b reply state 00000000ee24f8e6 transno 4294967418 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480907.476156:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1782480907.476189:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5a96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe67 expref: 19 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476204:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe67 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.476211:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c8d19500) 00010000:00010000:1.0:1782480907.476213:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480907.476215:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55f600, rc 0) 00000100:00100000:1.0:1782480907.476288:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:11321:x1869066366158336:12345-192.168.201.58@tcp:101:bash.0 Request processed in 1477us (3426us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1782480907.476297:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 143 00010000:00010000:2.0:1782480907.477827:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.477843:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.477849:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.477854:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480907.477859:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.477866:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.477908:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c8d19600) 00010000:00010000:2.0:1782480907.477911:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480907.477916:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.477924:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5aa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480907.481208:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480907.485810:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366158464 00000100:00100000:2.0:1782480907.485828:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366158464 00000100:00100000:2.0:1782480907.485943:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:2.0:1782480907.485956:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366158464:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1782480907.485979:0:6607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00000100:00080000:1.0:1782480907.486003:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782480907.486612:0:6607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004a61824c/0x4776e02a9acf5ab9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe6e expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1782480907.486806:0:6607:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1782480907.486833:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=438s v=(0 0) 00010000:00010000:2.0:1782480907.486837:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480907.486849:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004a61824c/0x4776e02a9acf5ab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe6e expref: 6 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.486871:0:6607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004a61824c/0x4776e02a9acf5ab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe6e expref: 6 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.486897:0:6607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d400, rc 0) 00000100:00100000:2.0:1782480907.486984:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366158464:12345-192.168.201.58@tcp:101:bash.0 Request processed in 1030us (5785us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.487762:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:3.0:1782480907.489418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480907.489603:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366158592 00000100:00100000:2.0:1782480907.489616:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366158592 00000100:00100000:2.0:1782480907.489701:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:2.0:1782480907.489710:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:11321:x1869066366158592:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1782480907.489775:0:8498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480907.489850:0:8498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe75 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.489895:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004a61824c/0x4776e02a9acf5ab9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe6e expref: 7 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.489904:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480907.489908:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480907.489914:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 7 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.489950:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004a61824c/0x4776e02a9acf5ab9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe6e expref: 7 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.489961:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004a61824c/0x4776e02a9acf5ab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe6e expref: 7 pid: 6607 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.489973:0:8498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8498:1869066388189568:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480907.490996:0:8498:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6478840 going to sleep for 11 seconds 00000100:00100000:3.0:1782480907.498995:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.499127:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366158720 00000100:00100000:0.0:1782480907.499139:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366158720 00010000:00010000:0.0:1782480907.499183:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004a61824c/0x4776e02a9acf5ab9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe6e expref: 8 pid: 6607 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480907.499229:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:0.0:1782480907.499241:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2351:x1869066366158720:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480907.499260:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480907.499285:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004a61824c/0x4776e02a9acf5ab9 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe6e expref: 8 pid: 6607 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.499298:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004a61824c/0x4776e02a9acf5ab9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe6e expref: 8 pid: 6607 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.499323:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480907.499326:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480907.499333:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 8 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.499357:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 8 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.499389:0:5788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 8 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480907.499400:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5788:1869066388189696:192.168.201.58@tcp:105: 00000100:00100000:0.0:1782480907.500395:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c780 going to sleep for 11 seconds 00010000:00010000:2.0:1782480907.501048:0:8498:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004a61824c/0x4776e02a9acf5ab9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe6e expref: 8 pid: 6607 timeout: 538 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.501066:0:8498:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8498:1869066388189568:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480907.501092:0:8498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 7 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.501103:0:8498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2ca00, rc 0) 00000100:00100000:2.0:1782480907.501142:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:11321:x1869066366158592:12345-192.168.201.58@tcp:101:bash.0 Request processed in 11433us (11733us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.501151:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1782480907.511055:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528ce00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5788:1869066388189696:192.168.201.58@tcp:105: 00010000:00010000:0.0:1782480907.511085:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480907.511111:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480907.511243:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366158976 00000100:00100000:1.0:1782480907.511250:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366158976 00000100:00100000:0.0:1782480907.511311:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366158720:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 12070us (12324us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.511321:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:1.0:1782480907.511449:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:1.0:1782480907.511460:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:11321:x1869066366158976:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:0.0:1782480907.511866:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:11321:x1869066366158976:12345-192.168.201.58@tcp:35:bash.0 Request processed in 408us (755us total) trans 4294967419 rc 0/0 00000100:00100000:0.0:1782480907.511874:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:3.0:1782480907.590317:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.590552:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366159232 00000100:00100000:0.0:1782480907.590563:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366159232 00000100:00100000:0.0:1782480907.590715:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 144 00000100:00100000:0.0:1782480907.590728:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:11331:x1869066366159232:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480907.590942:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480907.590968:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ac7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe7c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480907.591141:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1782480907.591320:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ac7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe7c expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.591358:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3300) 00010000:00010000:0.0:1782480907.591362:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480907.591367:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ac7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe7c expref: 21 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.591382:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782480907.592265:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:11331:x1869066366159232:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1532us (1952us total) trans 4294967420 rc 301/301 00000100:00100000:0.0:1782480907.592275:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 144 00000100:00100000:2.0:1782480907.602206:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.602683:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366159488 00000100:00100000:0.0:1782480907.602692:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366159488 00000100:00100000:0.0:1782480907.602756:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:0.0:1782480907.602767:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:11331:x1869066366159488:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1782480907.603088:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:11331:x1869066366159488:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 322us (903us total) trans 4294967421 rc 0/0 00000100:00100000:0.0:1782480907.603097:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:3.0:1782480907.727566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.727980:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366159616 00000100:00100000:0.0:1782480907.727994:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366159616 00000100:00100000:0.0:1782480907.728074:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 145 00000100:00100000:0.0:1782480907.728086:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:11337:x1869066366159616:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480907.728118:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480907.728160:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ad5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe83 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.728322:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5adc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.728339:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.728352:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480907.728420:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1782480907.728423:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480907.728447:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5adc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.728475:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ad5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe83 expref: 23 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.728496:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5adc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe83 expref: 22 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.728507:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480907.728510:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480907.728514:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a600, rc 0) 00000100:00100000:0.0:1782480907.729174:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:11337:x1869066366159616:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1085us (1626us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.729184:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 145 00000100:00100000:1.0:1782480907.733541:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480907.733678:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366159872 00000100:00100000:2.0:1782480907.733690:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366159872 00000100:00100000:2.0:1782480907.733755:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 146 00000100:00100000:2.0:1782480907.733765:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:11337:x1869066366159872:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1782480907.733786:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480907.733809:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5ae3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe8a expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.733945:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5aea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.733959:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.733972:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5aea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480907.734006:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1782480907.734156:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5ae3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe8a expref: 25 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.734178:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5aea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe8a expref: 24 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.734186:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c8d19500) 00010000:00010000:2.0:1782480907.734189:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480907.734193:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2de00, rc 0) 00000100:00100000:2.0:1782480907.734484:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f99500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11337:x1869066366159872:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 720us (955us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1782480907.734493:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 146 00000100:00100000:3.0:1782480907.742339:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480907.742395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.742613:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366160256 00000100:00100000:0.0:1782480907.742638:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366160256 00000100:00100000:2.0:1782480907.742647:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366160000 00000100:00100000:2.0:1782480907.742650:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366160000 00000100:00100000:0.0:1782480907.742723:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 147 00000100:00100000:0.0:1782480907.742734:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+25:11337:x1869066366160256:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480907.742758:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480907.742779:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5af8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe91 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.742928:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5aff lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.742945:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.742959:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5aff lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480907.742974:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00000100:00100000:2.0:1782480907.743010:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782480907.743019:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:2350:x1869066366160000:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480907.743031:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480907.743049:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5aea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe8a expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.743066:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c8d19500) 00010000:00010000:2.0:1782480907.743071:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480907.743127:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5af8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe91 expref: 27 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.743135:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:2350:x1869066366160000:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 119us (810us total) trans 0 rc 0/0 00010000:00010000:0.0:1782480907.743141:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5aff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe91 expref: 26 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.743143:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00010000:00010000:0.0:1782480907.743148:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c8d19500) 00010000:00010000:0.0:1782480907.743151:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782480907.743153:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297be00, rc 0) 00000100:00100000:0.0:1782480907.743177:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+25:11337:x1869066366160256:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 446us (782us total) trans 4294967423 rc 0/0 00000100:00100000:0.0:1782480907.743184:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 147 00000100:00100000:3.0:1782480907.757422:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480907.757505:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366160384 00000100:00100000:2.0:1782480907.757516:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366160384 00000100:00100000:2.0:1782480907.757576:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:2.0:1782480907.757587:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366160384:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:2.0:1782480907.757634:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.757655:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 6 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.757703:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782480907.757707:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1782480907.757721:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 4/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.757864:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 6 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.757890:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 6 pid: 8498 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.757905:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1869066388189824:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480907.758000:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6478840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480907.764867:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea2680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1869066388189824:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480907.764908:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480907.765723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.765807:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366160512 00000100:00100000:0.0:1782480907.765826:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366160512 00002000:00100000:0.0:1782480907.765893:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91d7dfa55c00 x1869066366160512/t0(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:663/0 lens 504/0 e 0 to 0 dl 1782480918 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782480907.765903:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7dfa55c00 with x1869066366160512 ext(0->12) 00010000:00010000:0.0:1782480907.765912:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 7 pid: 8498 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.765927:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 7 pid: 8498 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480907.765934:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d7dfa55c00 00000100:00100000:0.0:1782480907.765968:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1782480907.765978:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366160512:12345-192.168.201.58@tcp:4:lfs.0 00000100:00100000:0.0:1782480907.766571:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2350:x1869066366160512:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 591us (855us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1782480907.766579:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00002000:00100000:0.0:1782480907.766586:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff91d7dfa55c00 x1869066366160512/t4294967305(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:663/0 lens 504/448 e 0 to 0 dl 1782480918 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1782480907.766594:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7dfa55c00 with x1869066366160512 ext(0->12) 00010000:00010000:0.0:1782480907.766600:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 9 pid: 8498 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.766612:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 9 pid: 8498 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480907.766630:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d7dfa55c00 00000100:00100000:1.0:1782480907.780028:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.780648:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366160640 00000100:00100000:0.0:1782480907.780696:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366160640 00010000:00010000:0.0:1782480907.780757:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 9 pid: 8498 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480907.780801:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:0.0:1782480907.780825:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2351:x1869066366160640:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480907.780842:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782480907.780862:0:5788:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1782480907.780865:0:5788:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1782480907 00002000:00010000:0.0:1782480907.780867:0:5788:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1782480908 00002000:00010000:0.0:1782480907.780869:0:5788:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1782480907 00010000:00010000:0.0:1782480907.780886:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 9 pid: 8498 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.780901:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 9 pid: 8498 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.780926:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000070de74a1/0x4776e02a9acf5ac0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe75 expref: 9 pid: 8498 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.780944:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480907.780948:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480907.780953:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.780978:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.781017:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480907.781081:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2351:x1869066366160640:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 269us (1064us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.781088:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00010000:00010000:2.0:1782480907.781155:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.781165:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.781191:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.781200:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.781208:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.781214:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2c200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782480907.781219:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.781227:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.781240:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.781261:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021fc80b1/0x4776e02a9acf5b0d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.781310:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa57100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366160384:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 23726us (23900us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.781319:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:0.0:1782480907.784545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480907.784837:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366160896 00000100:00100000:2.0:1782480907.784850:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366160896 00000100:00100000:2.0:1782480907.784914:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:2.0:1782480907.784923:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+25:11337:x1869066366160896:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:2.0:1782480907.785010:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5aff lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe91 expref: 25 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782480907.785374:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1782480907.785424:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1782480907.786092:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1782480907.786154:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.786174:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe67 expref: 29 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.786183:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.786224:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe67 expref: 29 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.786256:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe67 expref: 29 pid: 5802 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.786273:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1869066388189952:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480907.786365:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96240 going to sleep for 11 seconds 00000100:00100000:3.0:1782480907.796290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480907.796730:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366161024 00000100:00100000:2.0:1782480907.796742:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366161024 00010000:00010000:2.0:1782480907.796788:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe67 expref: 30 pid: 5802 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480907.796844:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:2.0:1782480907.796854:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:2351:x1869066366161024:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480907.796869:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480907.796886:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe67 expref: 30 pid: 5802 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.796901:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe67 expref: 30 pid: 5802 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.796925:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c8d19500) 00010000:00010000:2.0:1782480907.796931:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.796940:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.796967:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480907.796991:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480907.797054:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa55880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:2351:x1869066366161024:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 201us (776us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.797062:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00010000:00010000:0.0:1782480907.801022:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5aab lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe67 expref: 29 pid: 5802 timeout: 538 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480907.801761:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea2680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1869066388189952:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480907.801794:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.801805:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.801824:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480907.801994:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:0.0:1782480907.802244:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1782480907.802391:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c528ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388190080:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782480907.802470:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480907.802506:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dcba10c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480907.802822:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388190080 00000100:00100000:2.0:1782480907.802831:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388190080 00000100:00100000:2.0:1782480907.802887:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782480907.802898:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869066388190080:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782480907.802985:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869066388190080:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 90us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480907.802994:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782480907.803484:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c528ce00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388190080:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1782480907.804371:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:0.0:1782480907.804461:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388190208:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782480907.804523:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480907.805598:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480907.805732:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388190208 00000100:00100000:2.0:1782480907.805742:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388190208 00000100:00100000:2.0:1782480907.805803:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1782480907.805812:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869066388190208:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1782480907.806060:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5806:x1869066388190208:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 248us (1535us total) trans 4294967306 rc 0/0 00000100:00100000:2.0:1782480907.806068:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782480907.806230:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5af480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388190208:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1782480907.806310:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:1.0:1782480907.806362:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.806373:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.806394:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.806400:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2de00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480907.806405:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.806413:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.806431:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c8d19500) 00010000:00010000:1.0:1782480907.806434:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1782480907.806438:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.806445:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5b14 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480907.806722:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1782480907.806888:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8448 00000004:00080000:1.0:1782480907.806903:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 438368242960ns, next at 439368240195ns, rc = 0 00000001:00080000:1.0:1782480907.806910:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:1.0:1782480907.806945:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c8d19500) 00010000:00010000:1.0:1782480907.806948:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1782480907.806956:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5aff lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe91 expref: 33 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480907.807075:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b65450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11337:x1869066366160896:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 22151us (22542us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1782480907.807094:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00000020:00080000:1.0:1782480907.807099:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1782480907.812109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480907.812777:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366161152 00000100:00100000:0.0:1782480907.812789:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366161152 00000100:00100000:0.0:1782480907.812847:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 148 00000100:00100000:0.0:1782480907.812858:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11337:x1869066366161152:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480907.812898:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480907.812927:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5b1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe98 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.812994:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5b1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe98 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.813010:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5b1b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe98 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480907.813031:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:0.0:1782480907.813035:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480907.813038:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782480907.813113:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:11337:x1869066366161152:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 257us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480907.813121:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 148 00000100:00100000:1.0:1782480907.818045:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480907.818464:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366161408 00000100:00100000:3.0:1782480907.818477:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366161408 00000100:00100000:3.0:1782480907.818550:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:3.0:1782480907.818562:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:11337:x1869066366161408:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1782480907.818884:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:11337:x1869066366161408:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 313us (841us total) trans 4294967433 rc 0/0 00000100:00100000:3.0:1782480907.818893:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:3.0:1782480907.931725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480907.932015:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366161664 00000100:00100000:1.0:1782480907.932174:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366161664 00000100:00100000:1.0:1782480907.932322:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 149 00000100:00100000:1.0:1782480907.932691:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:11347:x1869066366161664:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782480907.932722:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480907.932744:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5b22 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fe9f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480907.933008:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:1.0:1782480907.933434:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5b22 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe9f expref: 36 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.933451:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3300) 00010000:00010000:1.0:1782480907.933454:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480907.933460:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5b22 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe9f expref: 36 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480907.933475:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55e200, rc 0) 00000100:00100000:1.0:1782480907.933612:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:11347:x1869066366161664:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1279us (1956us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1782480907.933621:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 149 00000100:00100000:0.0:1782480907.941965:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480907.943729:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366161792 00000100:00100000:3.0:1782480907.943741:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366161792 00000100:00100000:3.0:1782480907.943807:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 150 00000100:00100000:3.0:1782480907.943817:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:11347:x1869066366161792:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1782480907.943930:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5b30 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.943950:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5b30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.943986:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5b30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944002:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5b37 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944009:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944014:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944139:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944148:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944155:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480907.944199:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944212:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5b30 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944218:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5b30 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944224:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5b30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944240:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480907.944245:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5b30 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944254:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5b30 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944267:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480907.944271:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480907.944275:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5b30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944282:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5b30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944310:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5b37 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944316:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5b37 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944323:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5b37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944327:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480907.944330:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5b37 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944336:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5b37 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944352:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c51d1e00) 00010000:00010000:3.0:1782480907.944354:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480907.944357:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5b37 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944363:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5b37 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944380:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944386:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944391:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944396:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480907.944398:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944401:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944407:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480907.944409:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480907.944412:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480907.944418:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5b3e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480907.944523:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:11347:x1869066366161792:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 706us (2568us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480907.944532:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 150 00000100:00100000:2.0:1782480907.955800:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480907.955834:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366162048 00000100:00100000:3.0:1782480907.955845:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366162048 00000100:00100000:3.0:1782480907.955909:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:3.0:1782480907.955919:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:11347:x1869066366162048:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1782480907.956188:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:11347:x1869066366162048:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 270us (396us total) trans 4294967435 rc 0/0 00000100:00100000:3.0:1782480907.956207:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:1.0:1782480908.033319:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480908.033425:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366162304 00000100:00100000:0.0:1782480908.033434:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366162304 00000100:00100000:0.0:1782480908.033525:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 151 00000100:00100000:0.0:1782480908.033537:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:11350:x1869066366162304:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480908.033563:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480908.033585:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5b45 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fea6 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.033688:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b4c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.033703:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.033727:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.033744:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b53 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.033752:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.033758:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.033914:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.033923:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.033930:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480908.033952:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782480908.034054:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b4c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034063:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b4c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034070:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034077:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480908.034081:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b4c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034088:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b4c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034099:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480908.034102:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480908.034106:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b4c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034111:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b4c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034129:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b53 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034135:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b53 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034150:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034155:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480908.034157:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b53 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034163:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b53 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034170:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c32f3d00) 00010000:00010000:0.0:1782480908.034172:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480908.034174:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b53 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034179:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b53 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034222:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5b45 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fea6 expref: 39 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034236:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fea6 expref: 38 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.034244:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:0.0:1782480908.034246:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480908.034249:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297ba00, rc 0) 00000100:00100000:0.0:1782480908.034322:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f98e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:11350:x1869066366162304:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 787us (1012us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1782480908.034339:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 151 00000100:00100000:0.0:1782480908.042776:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480908.042984:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366162432 00000100:00100000:2.0:1782480908.042996:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366162432 00000100:00100000:2.0:1782480908.043063:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 152 00000100:00100000:2.0:1782480908.043073:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:11350:x1869066366162432:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:2.0:1782480908.043160:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b68 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.043178:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.043201:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.043227:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b68 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.043234:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b68 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.043241:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.043247:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2da00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480908.043251:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b68 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.043258:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b68 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.043269:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:2.0:1782480908.043272:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782480908.043276:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b68 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.043281:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b68 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480908.043371:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:11350:x1869066366162432:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 298us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480908.043379:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 152 00000100:00100000:2.0:1782480908.046094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480908.046312:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366162688 00000100:00100000:3.0:1782480908.046323:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366162688 00000100:00100000:3.0:1782480908.046378:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:3.0:1782480908.046386:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:11350:x1869066366162688:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1782480908.046638:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+39:11350:x1869066366162688:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 249us (551us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1782480908.046646:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00010000:00010000:2.0:1782480908.256806:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480908.374472:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480908.374630:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366162944 00000100:00100000:0.0:1782480908.374640:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366162944 00000100:00100000:0.0:1782480908.374738:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 153 00000100:00100000:0.0:1782480908.374749:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+39:11381:x1869066366162944:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:0.0:1782480908.374774:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480908.374798:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b6f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fead expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.374919:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.374935:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.374947:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480908.374959:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1782480908.375095:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b6f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fead expref: 42 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.375113:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fead expref: 41 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.375122:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:0.0:1782480908.375126:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480908.375153:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b200, rc 0) 00000100:00100000:0.0:1782480908.375222:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:11381:x1869066366162944:12345-192.168.201.58@tcp:101:cat.0 Request processed in 475us (759us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1782480908.375230:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 153 00000100:00100000:0.0:1782480908.383415:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480908.383465:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480908.383542:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366163328 00000100:00100000:1.0:1782480908.383578:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366163328 00000100:00100000:1.0:1782480908.383650:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1782480908.383684:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:2351:x1869066366163328:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480908.383701:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480908.383726:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5b76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fead expref: 41 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.383750:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:1.0:1782480908.383755:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480908.383813:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+40:2351:x1869066366163328:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 153us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480908.383822:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:3.0:1782480908.384102:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366163200 00000100:00100000:3.0:1782480908.384109:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366163200 00000100:00100000:3.0:1782480908.384147:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:3.0:1782480908.384232:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+40:11381:x1869066366163200:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:3.0:1782480908.384506:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:11381:x1869066366163200:12345-192.168.201.58@tcp:35:cat.0 Request processed in 351us (1101us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1782480908.384513:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:0.0:1782480908.457043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480908.457155:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366163584 00000100:00100000:2.0:1782480908.457165:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366163584 00000100:00100000:2.0:1782480908.457227:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 154 00000100:00100000:2.0:1782480908.457238:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:11387:x1869066366163584:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:2.0:1782480908.457265:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480908.457268:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1782480908.457296:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5adc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe83 expref: 41 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.457315:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:2.0:1782480908.457320:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480908.457336:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5b84 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99feb4 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.457441:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.457455:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fea6 expref: 41 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.457463:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.457515:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fea6 expref: 41 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.457527:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fea6 expref: 41 pid: 6840 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480908.457540:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388190336:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480908.457644:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96b40 going to sleep for 11 seconds 00000100:00100000:2.0:1782480908.461586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480908.461802:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea1880 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388190336:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480908.461845:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480908.461942:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366163712 00000100:00100000:0.0:1782480908.461953:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366163712 00010000:00010000:0.0:1782480908.462022:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fea6 expref: 42 pid: 6840 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480908.462076:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:0.0:1782480908.462087:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+42:2351:x1869066366163712:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480908.462106:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480908.462115:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fea6 expref: 42 pid: 6840 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.462129:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fea6 expref: 42 pid: 6840 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.462160:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5b5a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fea6 expref: 42 pid: 6840 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.462182:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:0.0:1782480908.462187:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.462216:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.462224:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.462261:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480908.462316:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10f1850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:2351:x1869066366163712:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 230us (742us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480908.462325:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00010000:00010000:3.0:1782480908.463070:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.463080:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480908.463101:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1782480908.463276:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5b84 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99feb4 expref: 42 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.463293:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99feb4 expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.463301:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480908.463304:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782480908.463306:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2da00, rc 0) 00000100:00100000:3.0:1782480908.463347:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:11387:x1869066366163584:12345-192.168.201.58@tcp:101:dd.0 Request processed in 6111us (6313us total) trans 4294967440 rc 0/0 00000100:00100000:3.0:1782480908.463355:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 154 00000100:00100000:2.0:1782480908.467782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480908.467966:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366163968 00000100:00100000:0.0:1782480908.467978:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366163968 00000100:00100000:0.0:1782480908.468032:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 155 00000100:00100000:0.0:1782480908.468043:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+41:11387:x1869066366163968:12345-192.168.201.58@tcp:36:dd.0 00010000:00010000:0.0:1782480908.468318:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.468336:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.468348:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480908.468402:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1782480908.468430:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000008f991be4 reply state 00000000c651d2ea transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480908.468439:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480908.468542:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+44:11387:x1869066366163968:12345-192.168.201.58@tcp:36:dd.0 Request processed in 499us (767us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1782480908.468567:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 155 00000020:00080000:0.0:1782480908.468573:0:6840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1782480908.471229:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471247:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471256:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471262:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480908.471267:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471295:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471311:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:1.0:1782480908.471314:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480908.471319:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.471326:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5b99 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480908.768619:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480908.768779:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366164096 00000100:00100000:1.0:1782480908.768792:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366164096 00000100:00100000:1.0:1782480908.768879:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 156 00000100:00100000:1.0:1782480908.768890:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+43:11401:x1869066366164096:12345-192.168.201.58@tcp:101:stat.0 00010000:00010000:1.0:1782480908.768921:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480908.768954:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5ba0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99febb expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769048:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5ba7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769077:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769089:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769105:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5bae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769127:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769134:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769461:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769474:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99feb4 expref: 44 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769484:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769523:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99feb4 expref: 44 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.769537:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99feb4 expref: 44 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480908.769552:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4f99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388190464:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480908.770355:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c309d300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480908.781955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480908.781993:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366164352 00000100:00100000:3.0:1782480908.782002:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366164352 00000100:00100000:3.0:1782480908.782057:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:3.0:1782480908.782067:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+45:5566:x1869066366164352:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782480908.782568:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+46:5566:x1869066366164352:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 500us (622us total) trans 4294967443 rc 0/0 00000100:00100000:3.0:1782480908.782576:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:1.0:1782480908.783517:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4f99f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388190464:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480908.783550:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480908.786030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480908.786429:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366164480 00000100:00100000:3.0:1782480908.786446:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366164480 00010000:00010000:3.0:1782480908.786491:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99feb4 expref: 46 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480908.786534:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:3.0:1782480908.786544:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+46:2350:x1869066366164480:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480908.786560:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480908.786567:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99feb4 expref: 46 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.786579:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99feb4 expref: 46 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.786619:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2da00/0x4776e02a9acf5b8b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99feb4 expref: 46 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.786639:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480908.786645:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.786687:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.786867:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.786906:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480908.786984:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f99f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+45:2350:x1869066366164480:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 440us (963us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480908.787006:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00010000:00010000:1.0:1782480908.787791:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.787803:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480908.787876:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1782480908.787882:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480908.787909:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.787925:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.787936:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5ba7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.787942:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5ba7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.787949:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.787956:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55fa00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480908.787961:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5ba7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.787969:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5ba7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.787984:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:1.0:1782480908.787987:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480908.787992:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5ba7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788010:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5ba7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788025:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5bae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788031:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5bae lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788037:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5bae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788042:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480908.788045:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5bae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788050:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5bae lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788058:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c8d19300) 00010000:00010000:1.0:1782480908.788061:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480908.788063:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5bae lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788069:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5bae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788113:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5ba0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99febb expref: 45 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788127:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99febb expref: 44 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480908.788141:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:1.0:1782480908.788144:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480908.788147:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55f600, rc 0) 00000100:00100000:1.0:1782480908.788196:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+44:11401:x1869066366164096:12345-192.168.201.58@tcp:101:stat.0 Request processed in 19308us (19602us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480908.788205:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 156 00000001:00080000:3.0:1782480908.812301:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967442 is committed 00000020:00080000:3.0:1782480908.812329:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d802159180 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:3.0:1782480908.812335:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c7c83700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d802159a80 00000020:00080000:3.0:1782480908.812339:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c7c83100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d7c3875c00 00000004:00080000:3.0:1782480908.812377:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000100:00100000:3.0:1782480908.812560:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388190592:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782480908.812648:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:2.0:1782480908.812786:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:2.0:1782480908.812978:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:3.0:1782480908.813654:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388190592 00000100:00100000:3.0:1782480908.813709:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388190592 00000100:00100000:3.0:1782480908.813772:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782480908.813782:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388190592:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:3.0:1782480908.813811:0:6609:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:4 count 1 00002000:00010000:3.0:1782480908.813846:0:6609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a3e800b, atime: 0x6a3e800c, ctime: 0x6a3e800b, blocks: 0x1 00010000:00010000:3.0:1782480908.813866:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a595bb00/0x4776e02a9acf5bbc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.813886:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=439s v=(0 0) 00010000:00010000:3.0:1782480908.813890:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480908.813898:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a595bb00/0x4776e02a9acf5bbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.813915:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a595bb00/0x4776e02a9acf5bbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.813947:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a595bb00/0x4776e02a9acf5bbc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.813956:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a595bb00/0x4776e02a9acf5bbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480908.813973:0:6609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782480908.814527:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1869066388190592:12345-0@lo:6:osp-syn-1-0.0 Request processed in 743us (1875us total) trans 4294967307 rc 0/0 00000100:00100000:3.0:1782480908.814536:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000004:00080000:3.0:1782480908.814597:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7dfa57800/2, rc 0, transno 4294967307 00000100:00100000:3.0:1782480908.814605:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfa57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388190592:0@lo:6:osp-syn-1-0.0 00010000:00010000:0.0:1782480908.815565:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480908.815576:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a595bb00/0x4776e02a9acf5bbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.815587:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779be00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480908.815592:0:8324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a595bb00/0x4776e02a9acf5bbc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.815613:0:8324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a595bb00/0x4776e02a9acf5bbc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.815633:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a595bb00/0x4776e02a9acf5bbc lrc: 1/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.815641:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a595bb00/0x4776e02a9acf5bbc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.815710:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.815712:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480908.815713:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480908.866088:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480908.866302:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366164736 00000100:00100000:0.0:1782480908.866313:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366164736 00000100:00100000:0.0:1782480908.866387:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 157 00000100:00100000:0.0:1782480908.866401:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+17:11407:x1869066366164736:12345-192.168.201.58@tcp:36:truncate.0 00010000:00010000:0.0:1782480908.866503:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480908.866534:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5bb5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99febb expref: 17 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.866553:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:0.0:1782480908.866557:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480908.866980:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.866997:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480908.867008:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480908.867253:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:0.0:1782480908.867283:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000009276a4f6 reply state 00000000151897ba transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480908.867294:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480908.867481:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:11407:x1869066366164736:12345-192.168.201.58@tcp:36:truncate.0 Request processed in 1083us (1402us total) trans 4294967445 rc 0/0 00000100:00100000:0.0:1782480908.867490:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 157 00000020:00080000:0.0:1782480908.867495:0:6840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782480908.870223:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.870242:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.870248:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.870255:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480908.870260:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.870268:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.870283:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:2.0:1782480908.870301:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480908.870307:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480908.870313:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bc3 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480909.107129:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480909.109494:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366164864 00000100:00100000:0.0:1782480909.109513:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366164864 00000100:00100000:0.0:1782480909.109628:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 158 00000100:00100000:0.0:1782480909.109646:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:11421:x1869066366164864:12345-192.168.201.58@tcp:101:stat.0 00000100:00080000:1.0:1782480909.109880:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1782480909.109979:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480909.110020:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5bca lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fec2 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.110103:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bd1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.110120:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.110133:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.110148:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bd8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.110156:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.110162:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.112305:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.112556:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.112569:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480909.112620:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:0.0:1782480909.112625:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480909.112654:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.112929:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.112940:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bd1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.112948:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bd1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.112955:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.112961:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480909.112965:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bd1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.112972:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bd1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.112986:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480909.112989:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480909.112993:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bd1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113000:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bd1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113020:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bd8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113027:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bd8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113039:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113045:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480909.113048:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bd8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113055:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bd8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113063:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c32f3d00) 00010000:00010000:0.0:1782480909.113065:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480909.113068:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bd8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113073:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bd8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113115:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5bca lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec2 expref: 20 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113131:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec2 expref: 19 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.113138:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:0.0:1782480909.113140:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480909.113143:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b200, rc 0) 00000100:00100000:0.0:1782480909.113310:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:11421:x1869066366164864:12345-192.168.201.58@tcp:101:stat.0 Request processed in 3670us (6540us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480909.113341:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 158 00000100:00100000:3.0:1782480909.271860:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480909.272009:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366165120 00000100:00100000:1.0:1782480909.272019:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366165120 00000100:00100000:1.0:1782480909.272083:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 159 00000100:00100000:1.0:1782480909.272093:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:11431:x1869066366165120:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782480909.272116:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480909.272137:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5be6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fec9 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480909.272416:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:1.0:1782480909.272920:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5be6 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec9 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.272938:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3300) 00010000:00010000:1.0:1782480909.272941:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480909.272946:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5be6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec9 expref: 21 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.272960:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55fa00, rc 0) 00000100:00100000:1.0:1782480909.273526:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:11431:x1869066366165120:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1430us (1679us total) trans 4294967446 rc 301/301 00000100:00100000:1.0:1782480909.273545:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 159 00010000:00010000:3.0:1782480909.283463:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480909.289044:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.289260:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366165376 00000100:00100000:3.0:1782480909.289272:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366165376 00000100:00100000:3.0:1782480909.289348:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:3.0:1782480909.289361:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b64050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:11431:x1869066366165376:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1782480909.299982:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b64050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:11431:x1869066366165376:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 10608us (10933us total) trans 4294967447 rc 0/0 00000100:00100000:3.0:1782480909.300001:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:2.0:1782480909.421203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480909.421577:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366165632 00000100:00100000:1.0:1782480909.421597:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366165632 00000100:00100000:0.0:1782480909.421813:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 160 00000100:00100000:0.0:1782480909.421826:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:11437:x1869066366165632:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1782480909.421863:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480909.421888:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bf4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fed0 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.421998:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.422014:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec2 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.422023:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.422071:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec2 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.422084:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec2 expref: 22 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480909.422097:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388190720:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480909.422200:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c240 going to sleep for 11 seconds 00000100:00100000:0.0:1782480909.425983:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.426203:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ae300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388190720:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480909.426243:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480909.426321:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366165760 00000100:00100000:1.0:1782480909.426328:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366165760 00010000:00010000:1.0:1782480909.426368:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec2 expref: 23 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480909.426411:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:1.0:1782480909.426420:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:2351:x1869066366165760:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480909.426436:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480909.426444:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec2 expref: 23 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.426456:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec2 expref: 23 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.426480:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5bdf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fec2 expref: 23 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.426502:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:1.0:1782480909.426507:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.426517:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.426538:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.426568:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480909.427014:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:2351:x1869066366165760:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 592us (1038us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480909.427023:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00010000:00010000:3.0:1782480909.427143:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.427151:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480909.427170:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:3.0:1782480909.427328:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5bf4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed0 expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.427344:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed0 expref: 22 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.427351:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480909.427353:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782480909.427356:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297ba00, rc 0) 00000100:00100000:3.0:1782480909.427382:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:11437:x1869066366165632:12345-192.168.201.58@tcp:101:bash.0 Request processed in 5560us (6191us total) trans 4294967448 rc 0/0 00000100:00100000:3.0:1782480909.427390:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 160 00000100:00100000:2.0:1782480909.431277:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480909.431387:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366166016 00000100:00100000:0.0:1782480909.431397:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366166016 00000100:00100000:0.0:1782480909.431502:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 161 00000100:00100000:0.0:1782480909.431513:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:11437:x1869066366166016:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:0.0:1782480909.431859:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.431875:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.431885:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480909.431938:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:0.0:1782480909.431962:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ea351697 reply state 00000000319be399 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480909.431971:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480909.432089:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+25:11437:x1869066366166016:12345-192.168.201.58@tcp:36:bash.0 Request processed in 576us (820us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1782480909.432097:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 161 00000020:00080000:0.0:1782480909.432102:0:6840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782480909.437378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1782480909.437422:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.437436:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.437444:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.437469:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480909.437474:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.437482:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.437499:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480909.437502:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480909.437507:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.437513:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5c09 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480909.438371:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366166144 00000100:00100000:1.0:1782480909.438386:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366166144 00000100:00100000:1.0:1782480909.438448:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00100000:1.0:1782480909.438460:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11437:x1869066366166144:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1782480909.438488:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480909.438509:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5c10 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fed7 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.438595:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.438609:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed0 expref: 25 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.438618:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.438653:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed0 expref: 25 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.438854:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed0 expref: 25 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480909.438882:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4f9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388190848:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480909.438974:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ca531840 going to sleep for 11 seconds 00000100:00100000:1.0:1782480909.441987:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480909.442485:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366166272 00000100:00100000:2.0:1782480909.442494:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366166272 00010000:00010000:2.0:1782480909.442537:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed0 expref: 26 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480909.442579:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:2.0:1782480909.442589:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:2351:x1869066366166272:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480909.442616:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480909.442623:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed0 expref: 26 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.442636:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed0 expref: 26 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.442696:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:2.0:1782480909.442703:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.442714:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.442736:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.442756:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480909.442811:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:2351:x1869066366166272:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 222us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480909.442818:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 66 00010000:00010000:3.0:1782480909.443748:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5bfb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed0 expref: 25 pid: 5803 timeout: 539 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480909.443773:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4f9b800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388190848:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480909.443792:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.443802:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.443809:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480909.443869:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1782480909.443882:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480909.443909:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.443942:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5c10 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed7 expref: 25 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.443957:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed7 expref: 24 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.443966:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480909.443969:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480909.443972:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55fe00, rc 0) 00000100:00100000:3.0:1782480909.444012:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11437:x1869066366166144:12345-192.168.201.58@tcp:101:bash.0 Request processed in 5555us (6644us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480909.444019:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 162 00000100:00100000:1.0:1782480909.446601:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480909.446717:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366166528 00000100:00100000:2.0:1782480909.446727:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366166528 00000100:00100000:2.0:1782480909.446780:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1782480909.446789:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11437:x1869066366166528:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:2.0:1782480909.447059:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+25:11437:x1869066366166528:12345-192.168.201.58@tcp:35:bash.0 Request processed in 270us (477us total) trans 4294967451 rc 0/0 00000100:00100000:2.0:1782480909.447068:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1782480909.528387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.528514:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366166784 00000100:00100000:3.0:1782480909.528526:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366166784 00000100:00100000:3.0:1782480909.528608:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 163 00000100:00100000:3.0:1782480909.528619:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+25:11447:x1869066366166784:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480909.528650:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480909.528720:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c1e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fede expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480909.528998:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1782480909.529180:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c1e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fede expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.529196:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3300) 00010000:00010000:3.0:1782480909.529206:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480909.529212:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c1e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fede expref: 27 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.529227:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a600, rc 0) 00000100:00100000:3.0:1782480909.529286:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:11447:x1869066366166784:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 669us (912us total) trans 4294967452 rc 301/301 00000100:00100000:3.0:1782480909.529294:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 163 00000100:00100000:1.0:1782480909.535089:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.535304:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366166912 00000100:00100000:3.0:1782480909.535314:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366166912 00000100:00100000:3.0:1782480909.535380:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 164 00000100:00100000:3.0:1782480909.535390:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:11447:x1869066366166912:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1782480909.535473:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c2c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.535492:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.535505:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.535520:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c33 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.535527:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.535533:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536014:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536032:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536039:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480909.536377:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536393:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c2c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536401:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c2c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536408:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536415:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480909.536419:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c2c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536427:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c2c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536440:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480909.536443:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480909.536448:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c2c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536454:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c2c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536476:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c33 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536482:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c33 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536489:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536493:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480909.536496:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c33 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536501:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c33 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536509:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c51d1900) 00010000:00010000:3.0:1782480909.536512:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480909.536514:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c33 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536520:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c33 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536537:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536543:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536549:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536561:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480909.536564:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536570:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536578:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480909.536581:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480909.536584:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.536590:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c3a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480909.536951:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:11447:x1869066366166912:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 1557us (1870us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480909.536960:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 164 00000100:00100000:1.0:1782480909.540009:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480909.540158:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366167168 00000100:00100000:2.0:1782480909.540171:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366167168 00000100:00100000:2.0:1782480909.540245:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:2.0:1782480909.540256:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:11447:x1869066366167168:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1782480909.540944:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:11447:x1869066366167168:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 686us (941us total) trans 4294967453 rc 0/0 00000100:00100000:2.0:1782480909.540954:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:0.0:1782480909.581818:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.582022:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366167424 00000100:00100000:3.0:1782480909.582032:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366167424 00000100:00100000:3.0:1782480909.582094:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 165 00000100:00100000:3.0:1782480909.582104:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:11450:x1869066366167424:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480909.582130:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480909.582161:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fee5 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.582235:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c48 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.582277:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.582290:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.582306:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c4f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.582313:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.582320:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583012:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c56 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583023:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583031:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c56 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480909.583043:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1782480909.583199:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c48 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583207:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c48 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583213:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583226:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480909.583230:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c48 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583238:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c48 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583250:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480909.583253:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480909.583258:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c48 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583322:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5c48 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583338:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c4f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583344:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c4f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583350:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583354:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480909.583357:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c4f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583363:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c4f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583383:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c51d1900) 00010000:00010000:3.0:1782480909.583385:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480909.583388:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c4f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583393:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5c4f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583447:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5c41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fee5 expref: 30 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583463:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c56 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fee5 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.583470:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480909.583472:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480909.583475:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779be00, rc 0) 00000100:00100000:3.0:1782480909.583554:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5af800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:11450:x1869066366167424:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1451us (1746us total) trans 4294967454 rc 0/0 00000100:00100000:3.0:1782480909.583563:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 165 00000100:00100000:1.0:1782480909.590058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.590158:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366167552 00000100:00100000:3.0:1782480909.590168:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366167552 00000100:00100000:3.0:1782480909.590232:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 166 00000100:00100000:3.0:1782480909.590242:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:11450:x1869066366167552:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1782480909.590529:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.590548:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.590574:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.590603:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.590609:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.590615:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.590804:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480909.590810:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.590818:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.590832:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480909.590835:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480909.590849:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.590856:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480909.590929:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:11450:x1869066366167552:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 687us (878us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480909.590937:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 166 00000100:00100000:1.0:1782480909.591026:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.592099:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366167680 00000100:00100000:3.0:1782480909.592120:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366167680 00000100:00100000:3.0:1782480909.592993:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:3.0:1782480909.593011:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:2353:x1869066366167680:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480909.593031:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480909.593060:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c56 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fee5 expref: 29 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.593080:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480909.593086:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480909.593921:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:2353:x1869066366167680:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 911us (2889us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480909.593932:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:1.0:1782480909.594238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.594873:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366167936 00000100:00100000:3.0:1782480909.594883:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366167936 00000100:00100000:3.0:1782480909.594933:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:3.0:1782480909.594942:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:11450:x1869066366167936:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1782480909.595472:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:11450:x1869066366167936:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 528us (1233us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1782480909.595480:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:3.0:1782480909.726973:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ecea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388190976:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480909.727055:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480909.727220:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388190976 00000100:00100000:2.0:1782480909.727228:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388190976 00000100:00100000:2.0:1782480909.727309:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782480909.727319:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388190976:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480909.727369:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480909.727420:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388190976:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (365us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480909.727440:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1782480909.727490:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ecea0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388190976:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782480909.727725:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480909.813766:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480909.813810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480909.813855:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480909.813898:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366168320 00000100:00100000:1.0:1782480909.813905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480909.813912:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366168320 00000100:00080000:1.0:1782480909.813945:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480909.813974:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366168192 00000100:00100000:0.0:1782480909.813978:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366168192 00000100:00100000:1.0:1782480909.813989:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:1.0:1782480909.814005:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366168320:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480909.814012:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:0.0:1782480909.814023:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366168192:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480909.814085:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366168192:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 65us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480909.814093:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:3.0:1782480909.814139:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366168448 00000100:00100000:3.0:1782480909.814145:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366168448 00000100:00080000:0.0:1782480909.814153:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480909.814158:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480909.814184:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 177 00000100:00100000:3.0:1782480909.814195:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2351:x1869066366168448:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480909.816047:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366168064 00000100:00100000:2.0:1782480909.816064:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366168064 00000100:00100000:2.0:1782480909.816132:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 305 00000100:00100000:2.0:1782480909.816142:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2351:x1869066366168064:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480909.818135:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366168320:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 4120us (4309us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480909.818159:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:3.0:1782480909.818571:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2351:x1869066366168448:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 4375us (4663us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480909.818597:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 177 00000100:00100000:2.0:1782480909.825484:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2351:x1869066366168064:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 9329us (11715us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480909.825501:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 305 00000100:00100000:2.0:1782480909.843921:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.844039:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366168704 00000100:00100000:3.0:1782480909.844517:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366168704 00000100:00100000:3.0:1782480909.844601:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 167 00000100:00100000:3.0:1782480909.844613:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:11468:x1869066366168704:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:3.0:1782480909.844642:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480909.844724:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c6b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99feec expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.844844:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c72 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.844861:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.844874:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c72 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480909.844887:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1782480909.845032:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c6b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99feec expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.845064:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c72 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99feec expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.845074:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:3.0:1782480909.845077:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782480909.845081:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b200, rc 0) 00000100:00100000:3.0:1782480909.845189:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11468:x1869066366168704:12345-192.168.201.58@tcp:101:cat.0 Request processed in 578us (1283us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1782480909.845196:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 167 00000100:00100000:0.0:1782480909.888702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480909.888897:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366168832 00000100:00100000:2.0:1782480909.888909:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366168832 00000100:00100000:2.0:1782480909.888978:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 168 00000100:00100000:2.0:1782480909.888990:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11469:x1869066366168832:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1782480909.889018:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480909.889041:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5c80 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fef3 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.889149:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5c87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.889164:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.889195:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480909.889567:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:2.0:1782480909.889572:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480909.889684:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5c87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.889716:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf5c80 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fef3 expref: 33 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.889735:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5c87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fef3 expref: 32 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480909.889744:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:2.0:1782480909.889747:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480909.889751:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d200, rc 0) 00000100:00100000:2.0:1782480909.889824:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11469:x1869066366168832:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 836us (1169us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480909.889832:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 168 00000100:00100000:2.0:1782480909.899412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.899507:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366169216 00000100:00100000:3.0:1782480909.899518:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366169216 00000100:00100000:3.0:1782480909.899589:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:3.0:1782480909.899600:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11469:x1869066366169216:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1782480909.900304:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:11469:x1869066366169216:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 699us (896us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1782480909.900315:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1782480909.903548:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480909.903867:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366169344 00000100:00100000:1.0:1782480909.903881:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366169344 00000100:00100000:1.0:1782480909.904083:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1782480909.904095:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:11469:x1869066366169344:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:1.0:1782480909.904138:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1782480909.904170:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5c17 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fed7 expref: 33 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.904196:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b200/0x4776e02a9acf5c72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99feec expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.904208:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5b1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe98 expref: 31 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480909.904218:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3500) 00010000:00010000:1.0:1782480909.904230:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480909.904300:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:11469:x1869066366169344:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 208us (762us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480909.904309:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1782480909.907045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480909.907209:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366169472 00000100:00100000:3.0:1782480909.907219:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366169472 00000100:00100000:3.0:1782480909.907286:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 169 00000100:00100000:3.0:1782480909.907297:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:11469:x1869066366169472:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:3.0:1782480909.907431:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c8e lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.907448:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480909.907459:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782480909.907865:0:5804:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1782480909.907957:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:11469:x1869066366169472:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 661us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480909.907966:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 169 00000100:00100000:3.0:1782480909.942381:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480909.942607:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366169600 00000100:00100000:0.0:1782480909.942621:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366169600 00000100:00100000:0.0:1782480909.942736:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 170 00000100:00100000:0.0:1782480909.942747:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+30:11471:x1869066366169600:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480909.943146:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480909.943174:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5c95 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fefa expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.943251:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5c9c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.943267:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5c9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.943278:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5c9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.943292:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5ca3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.943299:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.943306:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.943931:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.943943:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.943951:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480909.944010:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782480909.944014:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480909.944038:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944171:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944183:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5c9c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944189:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5c9c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944196:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5c9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944202:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480909.944207:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5c9c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944215:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5c9c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944237:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480909.944240:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480909.944246:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5c9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944253:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5c9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944266:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5ca3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944272:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5ca3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944278:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944283:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480909.944286:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5ca3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944292:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5ca3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944300:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c32f3d00) 00010000:00010000:0.0:1782480909.944302:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480909.944305:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5ca3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944311:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5ca3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944362:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5c95 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fefa expref: 32 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944377:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fefa expref: 31 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480909.944384:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:0.0:1782480909.944386:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480909.944388:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b200, rc 0) 00000100:00100000:0.0:1782480909.944473:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11471:x1869066366169600:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1727us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480909.944483:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 170 00000040:00080000:0.0:1782480910.175118:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480910.175130:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480910.175191:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1782480910.175200:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480910.175334:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388191104:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782480910.175452:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480910.181347:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ace00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388191104:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782480910.197413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480910.201698:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366169728 00000100:00100000:0.0:1782480910.201715:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366169728 00000100:00100000:0.0:1782480910.201813:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 171 00000100:00100000:0.0:1782480910.201827:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11482:x1869066366169728:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782480910.201879:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782480910.202010:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11482:x1869066366169728:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 186us (4611us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480910.202034:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 171 00000100:00100000:3.0:1782480910.205612:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480910.206065:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366169856 00000100:00100000:0.0:1782480910.206078:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366169856 00000100:00100000:0.0:1782480910.206150:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 172 00000100:00100000:0.0:1782480910.206162:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11482:x1869066366169856:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782480910.206249:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5cb1 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206267:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206279:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206339:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5cb8 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206348:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206355:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206385:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206394:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206401:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480910.206463:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1782480910.206467:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480910.206483:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206496:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5cb1 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206503:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5cb1 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206510:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206517:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480910.206523:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5cb1 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206531:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5cb1 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206545:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:0.0:1782480910.206548:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480910.206554:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5cb1 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206560:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5cb1 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206578:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5cb8 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206598:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5cb8 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206604:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206609:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480910.206613:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5cb8 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206619:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5cb8 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206628:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff91d7c32f3d00) 00010000:00010000:0.0:1782480910.206631:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480910.206634:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5cb8 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206639:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5cb8 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206655:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206899:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206905:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206911:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480910.206920:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206926:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206935:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:0.0:1782480910.206938:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480910.206941:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.206947:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5cbf lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480910.207045:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11482:x1869066366169856:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 883us (1444us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480910.207054:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 172 00000100:00100000:3.0:1782480910.210127:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480910.210204:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366170112 00000100:00100000:0.0:1782480910.210213:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366170112 00000100:00100000:0.0:1782480910.210268:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 173 00000100:00100000:0.0:1782480910.210277:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11482:x1869066366170112:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480910.210298:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480910.210319:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5cc6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff01 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.210425:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5ccd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.210440:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.210469:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480910.210481:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1782480910.210919:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5ccd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.210928:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5ccd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.210936:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5ccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.210942:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480910.210947:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5ccd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.210954:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5ccd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.210968:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:0.0:1782480910.210971:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480910.210976:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5ccd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.210982:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5ccd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.211026:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5cc6 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff01 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.211047:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:0.0:1782480910.211049:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480910.211065:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5cc6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff01 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.211075:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a600, rc 0) 00000100:00100000:0.0:1782480910.211139:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11482:x1869066366170112:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 863us (1022us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1782480910.211148:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 173 00000100:00100000:1.0:1782480910.216199:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480910.216547:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366170240 00000100:00100000:0.0:1782480910.216559:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366170240 00000100:00100000:0.0:1782480910.216623:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 174 00000100:00100000:0.0:1782480910.216633:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11482:x1869066366170240:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782480910.216705:0:6840:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782480910.217017:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfb76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11482:x1869066366170240:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 384us (829us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480910.217026:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 174 00000100:00100000:1.0:1782480910.223716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480910.223887:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366170496 00000100:00100000:0.0:1782480910.223899:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366170496 00000100:00100000:0.0:1782480910.223964:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 175 00000100:00100000:0.0:1782480910.223974:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11482:x1869066366170496:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480910.223996:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480910.224000:0:5804:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782480910.224028:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf5c87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fef3 expref: 32 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.224070:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480910.224075:0:5804:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480910.224103:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5cdb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff08 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480910.226372:0:5804:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1782480910.226693:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5ce2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.226710:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.226721:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5ce2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.227559:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5cdb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff08 expref: 34 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.227619:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5ce2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff08 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.227629:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c8d19300) 00010000:00010000:1.0:1782480910.227632:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480910.227635:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55ec00, rc 0) 00000100:00100000:1.0:1782480910.227974:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed018a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:11482:x1869066366170496:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 3998us (4264us total) trans 4294967459 rc 0/0 00000100:00100000:1.0:1782480910.227985:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 175 00000100:00100000:3.0:1782480910.240552:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480910.240602:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366170752 00000100:00100000:3.0:1782480910.240613:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366170752 00000100:00100000:3.0:1782480910.241076:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 176 00000100:00100000:3.0:1782480910.241090:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:11482:x1869066366170752:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782480910.241158:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480910.241189:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5ce2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff08 expref: 33 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.241209:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c8d19300) 00010000:00010000:3.0:1782480910.241220:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480910.241246:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5cf0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.241259:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5cf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.241268:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5cf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.241283:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5cf7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x1ee547e1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.241290:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1ee547e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.241983:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1ee547e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.242274:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5cf0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.242282:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5cf0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.242288:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5cf0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.242979:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480910.242988:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5cf0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.242998:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5cf0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.243011:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480910.243014:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480910.243019:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5cf0 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.243025:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5cf0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.243039:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5cf7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x1ee547e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.243046:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5cf7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1ee547e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.243063:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5cf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1ee547e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.243068:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480910.243071:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5cf7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1ee547e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.243078:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5cf7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x1ee547e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.243087:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x1ee547e1 (ffff91d7c51d1200) 00010000:00010000:3.0:1782480910.243090:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480910.243093:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5cf7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1ee547e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.243097:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5cf7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x1ee547e1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480910.243271:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11482:x1869066366170752:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 2180us (2721us total) trans 0 rc -2/-2 00000100:00100000:3.0:1782480910.243281:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 176 00000100:00100000:1.0:1782480910.263369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480910.263503:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366170880 00000100:00100000:2.0:1782480910.263513:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366170880 00000100:00100000:2.0:1782480910.263588:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 177 00000100:00100000:2.0:1782480910.263599:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11482:x1869066366170880:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782480910.263622:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480910.263645:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5cfe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff0f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.263736:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.264063:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.264079:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.264190:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf5cfe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff0f expref: 34 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.264209:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff0f expref: 33 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.264218:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:2.0:1782480910.264221:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782480910.264224:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2de00, rc 0) 00000100:00100000:2.0:1782480910.264288:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:11482:x1869066366170880:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 691us (931us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480910.264371:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 177 00000100:00100000:1.0:1782480910.270371:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480910.270786:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366171136 00000100:00100000:3.0:1782480910.270797:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366171136 00000100:00100000:3.0:1782480910.270869:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 178 00000100:00100000:3.0:1782480910.270880:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+33:11482:x1869066366171136:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1782480910.270973:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.270990:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.271011:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782480910.271338:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].6, 88 off8648 00000004:00080000:3.0:1782480910.271350:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 440832690386ns, next at 441832688255ns, rc = 0 00000004:00010000:3.0:1782480910.271440:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e712043a reply state 00000000d3866107 transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480910.271451:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1782480910.271557:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe72680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:11482:x1869066366171136:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 677us (1192us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1782480910.271564:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 178 00010000:00010000:3.0:1782480910.273887:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.273905:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.273913:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.273920:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480910.273925:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.273933:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.273952:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:3.0:1782480910.273955:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782480910.273975:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.273982:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d0c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.276451:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480910.276634:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366171264 00000100:00100000:0.0:1782480910.276649:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366171264 00000100:00100000:0.0:1782480910.276836:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 179 00000100:00100000:0.0:1782480910.276850:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:11482:x1869066366171264:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480910.276887:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480910.276918:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5d13 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff16 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.277004:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5d13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff16 expref: 35 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.277021:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5d13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff16 expref: 35 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.277043:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:0.0:1782480910.277047:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480910.277051:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297ba00, rc 0) 00000100:00100000:0.0:1782480910.277130:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:11482:x1869066366171264:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 282us (1387us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480910.277137:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 179 00000100:00100000:1.0:1782480910.282243:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480910.283242:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366171392 00000100:00100000:0.0:1782480910.283264:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366171392 00000100:00100000:0.0:1782480910.283355:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:0.0:1782480910.283367:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366171392:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:0.0:1782480910.284041:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366171392:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 672us (1800us total) trans 4294967313 rc 0/0 00000100:00100000:0.0:1782480910.284051:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:3.0:1782480910.295420:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480910.295534:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366171648 00000100:00100000:0.0:1782480910.295548:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366171648 00000100:00100000:0.0:1782480910.295979:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:0.0:1782480910.295993:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:11482:x1869066366171648:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1782480910.296255:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:11482:x1869066366171648:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 265us (1682us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1782480910.296264:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00010000:00010000:2.0:1782480910.306513:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480910.307857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480910.307946:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366171904 00000100:00100000:3.0:1782480910.307958:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366171904 00000100:00100000:3.0:1782480910.308038:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 180 00000100:00100000:3.0:1782480910.308130:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:11482:x1869066366171904:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1782480910.309184:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:11482:x1869066366171904:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 1128us (1348us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480910.309194:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 180 00000100:00100000:2.0:1782480910.313959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480910.314108:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366172032 00000100:00100000:3.0:1782480910.314121:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366172032 00000100:00100000:3.0:1782480910.314189:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 181 00000100:00100000:3.0:1782480910.314201:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:11482:x1869066366172032:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480910.314225:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480910.314255:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d1a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff1d expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.314341:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5d21 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.314357:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.314369:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480910.314426:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480910.314446:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5d21 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.314472:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d1a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff1d expref: 38 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.314489:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5d21 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff1d expref: 37 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.314498:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:3.0:1782480910.314501:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782480910.314504:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a400, rc 0) 00000100:00100000:3.0:1782480910.314570:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:11482:x1869066366172032:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 371us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480910.315819:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 181 00000100:00100000:2.0:1782480910.318399:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480910.318534:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366172160 00000100:00100000:0.0:1782480910.318545:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366172160 00000100:00100000:0.0:1782480910.318625:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:0.0:1782480910.318635:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366172160:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480910.318709:0:8498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480910.318739:0:8498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5d28 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff24 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480910.318777:0:8498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e800e, blocks: 0x1 00010000:00010000:0.0:1782480910.318799:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=440s v=(0 0) 00010000:00010000:0.0:1782480910.318804:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480910.318814:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5d28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff24 expref: 8 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.318868:0:8498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5d28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff24 expref: 8 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.318881:0:8498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a200, rc 0) 00000100:00100000:0.0:1782480910.318950:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366172160:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 316us (561us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480910.318957:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:2.0:1782480910.328459:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480910.328601:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366172416 00000100:00100000:1.0:1782480910.328618:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366172416 00000100:00100000:1.0:1782480910.328743:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 182 00000100:00100000:1.0:1782480910.328753:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:11482:x1869066366172416:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1782480910.328877:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:11482:x1869066366172416:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 125us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480910.328885:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 182 00000100:00100000:2.0:1782480910.333207:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480910.333323:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366172544 00000100:00100000:1.0:1782480910.333333:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366172544 00000100:00100000:1.0:1782480910.333397:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:1.0:1782480910.333408:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:11482:x1869066366172544:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480910.333446:0:6607:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480910.333468:0:6607:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff2b expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.333505:0:6607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5d28 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff24 expref: 9 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.333515:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480910.333520:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480910.333525:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 9 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.333561:0:6607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5d28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff24 expref: 9 pid: 8498 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.333587:0:6607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5d28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff24 expref: 9 pid: 8498 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.333603:0:6607:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6607:1869066388191232:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480910.333748:0:6607:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ca531d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782480910.336368:0:6607:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6607:1869066388191232:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480910.336409:0:6607:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 9 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.336433:0:6607:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55ea00, rc 0) 00000100:00100000:1.0:1782480910.336529:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:11482:x1869066366172544:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 3122us (3333us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480910.336539:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:2.0:1782480910.341079:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480910.341216:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366172672 00000100:00100000:3.0:1782480910.341226:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366172672 00010000:00010000:3.0:1782480910.341273:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5d28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff24 expref: 9 pid: 8498 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480910.341408:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:3.0:1782480910.341420:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2350:x1869066366172672:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480910.341437:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480910.341461:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5d28 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff24 expref: 9 pid: 8498 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.341488:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5d28 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff24 expref: 9 pid: 8498 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.341515:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf5d28 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff24 expref: 9 pid: 8498 timeout: 540 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.341532:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480910.341536:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480910.341544:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 8 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.341555:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 8 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.341613:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 8 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480910.341630:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfa57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5787:1869066388191360:192.168.201.58@tcp:105: 00000100:00100000:3.0:1782480910.341787:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df4956c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480910.359417:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfa57480 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5787:1869066388191360:192.168.201.58@tcp:105: 00010000:00010000:0.0:1782480910.359452:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480910.359521:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366172672:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 18103us (18453us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480910.359533:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:2.0:1782480910.368801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480910.370021:0:6613:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366172800 00000100:00100000:3.0:1782480910.370034:0:6613:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366172800 00002000:00100000:3.0:1782480910.370099:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91d7ff0b3480 x1869066366172800/t0(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:666/0 lens 504/0 e 0 to 0 dl 1782480921 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480910.370111:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7ff0b3480 with x1869066366172800 ext(0->8) 00002000:00010000:3.0:1782480910.370133:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7ff0b3480 00000100:00100000:3.0:1782480910.370170:0:6613:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:3.0:1782480910.370180:0:6613:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366172800:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782480910.371281:0:6613:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:2350:x1869066366172800:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 1096us (2490us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1782480910.371300:0:6613:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00002000:00100000:3.0:1782480910.371310:0:6613:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_001: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff91d7ff0b3480 x1869066366172800/t4294967314(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:666/0 lens 504/448 e 0 to 0 dl 1782480921 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480910.371320:0:6613:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7ff0b3480 with x1869066366172800 ext(0->8) 00002000:00010000:3.0:1782480910.371325:0:6613:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7ff0b3480 00000100:00100000:3.0:1782480910.373556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480910.376135:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366172928 00000100:00100000:3.0:1782480910.376149:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366172928 00000100:00100000:3.0:1782480910.376216:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 183 00000100:00100000:3.0:1782480910.376228:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:11482:x1869066366172928:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1782480910.449625:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:11482:x1869066366172928:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 73389us (76067us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480910.449638:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 183 00000001:00080000:1.0:1782480910.449710:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000020:00080000:1.0:1782480910.449745:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000004:00080000:1.0:1782480910.449759:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1782480910.449806:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1782480910.449818:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1782480910.449952:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388191488:0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782480910.450012:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480910.450088:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388191488 00000100:00100000:1.0:1782480910.450096:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388191488 00000100:00100000:1.0:1782480910.450138:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1782480910.450146:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388191488:12345-0@lo:2:osp-syn-0-0.0 00002000:00010000:1.0:1782480910.450309:0:8498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1782480910.450313:0:8498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782480910 00002000:00010000:1.0:1782480910.450315:0:8498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1782480910.450317:0:8498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782480910 -> 1782480910 00002000:00010000:1.0:1782480910.450320:0:8498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1782480910.450355:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe71f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388191488:12345-0@lo:2:osp-syn-0-0.0 Request processed in 209us (342us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1782480910.450362:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1782480910.450406:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7efe73b80/2, rc 0, transno 4294967315 00000100:00100000:1.0:1782480910.450412:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388191488:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782480910.458007:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480910.458093:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366173056 00000100:00100000:2.0:1782480910.458103:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366173056 00000100:00100000:2.0:1782480910.458162:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:2.0:1782480910.458172:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:2352:x1869066366173056:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1782480910.529932:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:2352:x1869066366173056:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 71750us (71924us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480910.529946:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000001:00080000:3.0:1782480910.531107:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967313 is committed 00000001:00080000:3.0:1782480910.531129:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967315 is committed 00000001:00080000:3.0:1782480910.531135:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967314 is committed 00000100:00100000:1.0:1782480910.548720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480910.548764:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366173312 00000100:00100000:1.0:1782480910.548774:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366173312 00000100:00100000:1.0:1782480910.548967:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 184 00000100:00100000:1.0:1782480910.548978:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:11482:x1869066366173312:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782480910.549042:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480910.549075:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a400/0x4776e02a9acf5d21 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff1d expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.549097:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:1.0:1782480910.549102:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480910.549134:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.549148:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.549157:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782480910.549521:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000078cad697 reply state 000000007d9a6fd9 transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.549532:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782480910.551020:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:11482:x1869066366173312:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 2034us (2299us total) trans 4294967462 rc 0/0 00000100:00100000:1.0:1782480910.551043:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 184 00010000:00010000:3.0:1782480910.559479:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.559503:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.559511:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.559537:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55fc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480910.559542:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.559551:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.559571:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c610b200) 00000100:00100000:2.0:1782480910.560263:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1782480910.560365:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480910.560373:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.560381:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5d36 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.561322:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366173440 00000100:00100000:1.0:1782480910.561336:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366173440 00000100:00100000:1.0:1782480910.561407:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:1.0:1782480910.561419:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366173440:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1782480910.562400:0:8498:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1782480910.562407:0:8498:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1782480910 -> 1782480909 00002000:00010000:1.0:1782480910.562410:0:8498:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782480908 00002000:00010000:1.0:1782480910.562412:0:8498:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782480910 -> 1782480909 00002000:00010000:1.0:1782480910.562414:0:8498:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1782480910.562507:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366173440:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 1086us (2245us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1782480910.562517:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:3.0:1782480910.570614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480910.571273:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366173696 00000100:00100000:1.0:1782480910.571284:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366173696 00000100:00100000:1.0:1782480910.571347:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 185 00000100:00100000:1.0:1782480910.571358:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:11482:x1869066366173696:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782480910.571438:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.571456:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff0f expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.571466:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.571517:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff0f expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.571529:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff0f expref: 18 pid: 5802 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.571543:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388191616:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480910.571638:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ca531f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480910.575693:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70700 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388191616:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480910.575726:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480910.592725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480910.592814:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366173824 00000100:00100000:1.0:1782480910.592840:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366173824 00010000:00010000:1.0:1782480910.592886:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff0f expref: 19 pid: 5802 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.592921:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:1.0:1782480910.592931:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:2351:x1869066366173824:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480910.592944:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480910.592951:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff0f expref: 19 pid: 5802 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.592964:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff0f expref: 19 pid: 5802 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.592989:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2de00/0x4776e02a9acf5d05 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff0f expref: 19 pid: 5802 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.593009:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:1.0:1782480910.593029:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.593040:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.593049:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.593085:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480910.593153:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10f2850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:2351:x1869066366173824:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 222us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480910.593176:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00010000:00010000:3.0:1782480910.593727:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.593738:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.593771:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.593792:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.593800:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.593806:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55f600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480910.593810:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.593999:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.594015:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:3.0:1782480910.594018:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1782480910.594024:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.594031:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf5d3d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480910.594102:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+17:11482:x1869066366173696:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 22743us (23496us total) trans 0 rc -22/-22 00000100:00100000:3.0:1782480910.594112:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 185 00000100:00100000:0.0:1782480910.609885:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480910.610023:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366173952 00000100:00100000:1.0:1782480910.610040:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366173952 00000100:00100000:1.0:1782480910.610119:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:1.0:1782480910.610130:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366173952:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782480910.610193:0:6607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.610214:0:6607:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 8 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.610223:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1782480910.610228:0:6607:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480910.610232:0:6607:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.610269:0:6607:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 8 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.610296:0:6607:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 8 pid: 6607 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.610312:0:6607:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6607:1869066388191744:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480910.610408:0:6607:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c622e480 going to sleep for 11 seconds 00000100:00100000:1.0:1782480910.614947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480910.614983:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366174080 00000100:00100000:1.0:1782480910.614991:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366174080 00010000:00010000:1.0:1782480910.615029:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 9 pid: 6607 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.615226:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:1.0:1782480910.615239:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2351:x1869066366174080:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480910.615255:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480910.615281:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 9 pid: 6607 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.615296:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 9 pid: 6607 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.615324:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480910.615329:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1782480910.615334:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.615366:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.615391:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480910.615450:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2351:x1869066366174080:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 214us (512us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480910.615459:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00010000:00010000:2.0:1782480910.621035:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf5d2f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff2b expref: 8 pid: 6607 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480910.621064:0:6607:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6607:1869066388191744:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480910.621095:0:6607:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.621107:0:6607:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.621115:0:6607:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.621171:0:6607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.621181:0:6607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.621189:0:6607:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.621215:0:6607:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ee00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782480910.621220:0:6607:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.621230:0:6607:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.621250:0:6607:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.621258:0:6607:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf5d44 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480910.621356:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366173952:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 11226us (11480us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480910.621366:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:1.0:1782480910.628464:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480910.628527:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366174336 00000100:00100000:3.0:1782480910.628537:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366174336 00000100:00100000:3.0:1782480910.628610:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 186 00000100:00100000:3.0:1782480910.628620:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+17:11482:x1869066366174336:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782480910.629012:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d4b lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.629046:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.629059:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.629313:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.629326:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5d13 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff16 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.629335:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.629392:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5d13 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff16 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.629407:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5d13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff16 expref: 18 pid: 5802 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480910.629424:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe8ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388191872:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480910.629526:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782480910.633353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480910.633397:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366174464 00000100:00100000:2.0:1782480910.633406:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366174464 00010000:00010000:2.0:1782480910.633924:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5d13 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff16 expref: 19 pid: 5802 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480910.633965:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:2.0:1782480910.633978:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:2351:x1869066366174464:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480910.633995:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480910.634019:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5d13 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff16 expref: 19 pid: 5802 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.634034:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5d13 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff16 expref: 19 pid: 5802 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.634063:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:2.0:1782480910.634068:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.634078:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.634085:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480910.634105:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480910.634235:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:2351:x1869066366174464:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 189us (822us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480910.634244:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 70 00010000:00010000:3.0:1782480910.635333:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5d13 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff16 expref: 18 pid: 5802 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480910.635360:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe8ff100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388191872:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480910.635383:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.635409:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.635414:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480910.635623:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1782480910.639282:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:2.0:1782480910.639358:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1782480910.639451:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1869066388192000:0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782480910.639535:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480910.639779:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4480 going to sleep for 11 seconds 00000100:00100000:0.0:1782480910.640043:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388192000 00000100:00100000:0.0:1782480910.640051:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388192000 00000100:00100000:0.0:1782480910.640123:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782480910.640133:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5803:x1869066388192000:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782480910.640245:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5803:x1869066388192000:12345-0@lo:1000:mdt00_001.0 Request processed in 113us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480910.640253:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782480910.640370:0:5803:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:1.0:1782480910.640376:0:5803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7efe73b80, transno 4294967315 00000100:00100000:1.0:1782480910.640398:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1869066388192000:0@lo:1000:mdt00_001.0 00000001:00080000:1.0:1782480910.642514:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:1.0:1782480910.645068:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1869066388192128:0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782480910.645150:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480910.645187:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96780 going to sleep for 11 seconds 00000100:00100000:2.0:1782480910.645341:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388192128 00000100:00100000:2.0:1782480910.645348:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388192128 00000100:00100000:2.0:1782480910.645399:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782480910.645408:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5803:x1869066388192128:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1782480910.645811:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5803:x1869066388192128:12345-0@lo:1000:mdt00_001.0 Request processed in 402us (659us total) trans 4294967317 rc 0/0 00000100:00100000:2.0:1782480910.645979:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480910.653385:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1869066388192128:0@lo:1000:mdt00_001.0 00010000:00010000:1.0:1782480910.653443:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653456:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653464:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653470:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480910.653484:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653492:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653509:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:1.0:1782480910.653513:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480910.653518:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653523:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a600/0x4776e02a9acf5d52 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653556:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c8e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653562:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c8e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653648:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653744:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480910.653749:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c8e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653756:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c8e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653765:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:1.0:1782480910.653767:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1782480910.653777:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c8e lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653783:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779be00/0x4776e02a9acf5c8e lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653807:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653903:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fefa expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653914:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653955:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fefa expref: 21 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.653972:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fefa expref: 21 pid: 5803 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.653989:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388192256:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480910.654089:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480910.657193:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388192256:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480910.657224:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.660459:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480910.660519:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366174592 00000100:00100000:1.0:1782480910.660529:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366174592 00010000:00010000:1.0:1782480910.661760:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fefa expref: 22 pid: 5803 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480910.661815:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:1.0:1782480910.661966:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:2351:x1869066366174592:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480910.661990:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480910.661999:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fefa expref: 22 pid: 5803 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.662013:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fefa expref: 22 pid: 5803 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.662035:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5caa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99fefa expref: 22 pid: 5803 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.662067:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:1.0:1782480910.662073:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.662083:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.662091:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.662116:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480910.663277:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe71c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:2351:x1869066366174592:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1308us (2819us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480910.663289:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00010000:00010000:3.0:1782480910.663410:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663421:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663436:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663443:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663450:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663457:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ee00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480910.663460:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663467:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663496:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:3.0:1782480910.663499:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480910.663505:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663510:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ee00/0x4776e02a9acf5d59 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663524:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d4b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663529:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d4b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663534:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663538:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480910.663541:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d4b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663547:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d4b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663553:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:3.0:1782480910.663555:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782480910.663558:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d4b lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480910.663563:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d4b lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480910.664862:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe71500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:11482:x1869066366174336:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 36191us (36354us total) trans 4294967467 rc 0/0 00000100:00100000:3.0:1782480910.664877:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 186 00000020:00080000:3.0:1782480910.664883:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1782480910.671855:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480910.671866:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480910.672421:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1782480910.672450:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480910.673632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480910.674411:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366174848 00000100:00100000:0.0:1782480910.674424:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366174848 00000100:00100000:0.0:1782480910.674498:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:0.0:1782480910.674510:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:11482:x1869066366174848:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1782480910.676354:0:5805:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1782480910.676472:0:5805:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:1.0:1782480910.676530:0:5805:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.676558:0:5805:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.676584:0:5805:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.676594:0:5805:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.676600:0:5805:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.676605:0:5805:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480910.676628:0:5805:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782480910.676778:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b65850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:11482:x1869066366174848:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 2266us (3212us total) trans 4294967469 rc 0/0 00000100:00100000:1.0:1782480910.676789:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000020:00080000:1.0:1782480910.676795:0:5805:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1782480910.677059:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480910.677066:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.677074:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ea00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480910.677078:0:8324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.677085:0:8324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.677098:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff91d7c8d19700) 00010000:00010000:0.0:1782480910.677101:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1782480910.677105:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.677111:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5d60 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5805 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480910.677127:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480910.677129:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480910.677130:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1782480910.881070:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:2.0:1782480910.881094:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:2.0:1782480910.881100:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000040:00080000:2.0:1782480911.034333:0:12343:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782480911.034346:0:12343:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782480911.034385:0:12343:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1782480911.034392:0:12343:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480911.280416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480911.281743:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366175104 00000100:00100000:3.0:1782480911.281757:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366175104 00000100:00100000:3.0:1782480911.281889:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00100000:3.0:1782480911.281900:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:11492:x1869066366175104:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480911.281926:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480911.281949:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d67 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff32 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.282227:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5d6e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.283551:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5d6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.284358:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5d6e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480911.284384:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1782480911.284848:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5d67 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff32 expref: 25 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.284870:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5d6e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff32 expref: 24 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.284890:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480911.284893:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782480911.284897:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a800, rc 0) 00000100:00100000:3.0:1782480911.284979:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11492:x1869066366175104:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 3081us (4572us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1782480911.284988:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00080000:0.0:1782480911.285083:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480911.295793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480911.295852:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366175232 00000100:00100000:3.0:1782480911.295861:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366175232 00000100:00100000:3.0:1782480911.295913:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 188 00000100:00100000:3.0:1782480911.295923:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11492:x1869066366175232:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1782480911.296005:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5d7c lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296026:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296038:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296054:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d83 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296061:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296067:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296405:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296415:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296422:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480911.296460:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296469:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5d7c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296474:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5d7c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296478:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5d7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296482:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ae00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.296485:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5d7c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296490:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5d7c lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296499:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480911.296502:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.296506:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5d7c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296519:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5d7c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296532:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d83 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296537:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d83 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296543:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296547:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779bc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.296550:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d83 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296556:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d83 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296564:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c51d1900) 00010000:00010000:3.0:1782480911.296566:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.296569:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d83 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296575:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d83 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296593:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296600:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296611:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296616:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.296619:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296625:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296632:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1200) 00010000:00010000:3.0:1782480911.296635:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.296638:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.296643:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d8a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480911.296737:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8ff100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11492:x1869066366175232:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 814us (953us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480911.296744:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 188 00010000:00010000:3.0:1782480911.338199:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480911.366850:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480911.366905:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366175488 00000100:00100000:3.0:1782480911.366918:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366175488 00000100:00100000:3.0:1782480911.366986:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:3.0:1782480911.366998:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11496:x1869066366175488:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480911.367027:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480911.367057:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5d91 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff39 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.367177:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d98 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.367196:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.367209:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.367228:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d9f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.369360:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.369388:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.369800:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.369823:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.369831:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480911.369843:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1782480911.369945:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d98 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.369953:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d98 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.369968:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.369974:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.369978:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d98 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.369986:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d98 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.369999:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480911.370002:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.370006:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d98 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370012:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5d98 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370024:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d9f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370030:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d9f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370035:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370040:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779bc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.370043:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d9f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370059:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d9f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370068:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c51d1200) 00010000:00010000:3.0:1782480911.370070:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.370073:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d9f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370078:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5d9f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370384:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5d91 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff39 expref: 27 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370398:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff39 expref: 26 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.370405:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:3.0:1782480911.370408:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480911.370410:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ae00, rc 0) 00000100:00100000:3.0:1782480911.370489:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:11496:x1869066366175488:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 3492us (3652us total) trans 4294967471 rc 0/0 00000100:00100000:3.0:1782480911.370500:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 189 00000100:00100000:3.0:1782480911.378588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480911.378618:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366175616 00000100:00100000:3.0:1782480911.378628:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366175616 00000100:00100000:3.0:1782480911.378779:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:3.0:1782480911.378789:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:11496:x1869066366175616:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1782480911.378878:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5db4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.378893:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.378905:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.378930:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5db4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.378937:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5db4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.378944:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.378950:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.378954:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5db4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.378961:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5db4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.378971:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:3.0:1782480911.378974:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1782480911.378978:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5db4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.378983:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5db4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480911.379055:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:11496:x1869066366175616:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 267us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480911.379062:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 190 00000100:00100000:0.0:1782480911.383340:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480911.384800:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366175872 00000100:00100000:1.0:1782480911.384824:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366175872 00000100:00100000:1.0:1782480911.384894:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:1.0:1782480911.384904:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:11496:x1869066366175872:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1782480911.392893:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:11496:x1869066366175872:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 7977us (9551us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1782480911.392909:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:3.0:1782480911.441253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480911.441335:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366176128 00000100:00100000:1.0:1782480911.441371:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366176128 00000100:00100000:1.0:1782480911.441436:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:1.0:1782480911.441446:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:11030:x1869066366176128:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1782480911.441471:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480911.441491:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5dbb lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff40 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.441606:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.441619:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff39 expref: 28 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.441627:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.441697:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff39 expref: 28 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.441711:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff39 expref: 28 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480911.441725:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388192384:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480911.441885:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c240 going to sleep for 11 seconds 00000100:00100000:3.0:1782480911.446699:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480911.446854:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388192384:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480911.446883:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480911.447411:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366176256 00000100:00100000:1.0:1782480911.447420:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366176256 00010000:00010000:1.0:1782480911.447464:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff39 expref: 29 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480911.447507:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:1.0:1782480911.447529:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:2351:x1869066366176256:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480911.447546:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480911.447553:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff39 expref: 29 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.447586:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff39 expref: 29 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.447610:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ae00/0x4776e02a9acf5da6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff39 expref: 29 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.447628:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:1.0:1782480911.447633:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.447642:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.447650:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.447690:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480911.447720:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.447729:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480911.447749:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00000100:00100000:1.0:1782480911.447755:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:2351:x1869066366176256:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 225us (1101us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480911.447764:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00010000:00010000:0.0:1782480911.447918:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5dbb lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff40 expref: 29 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.447947:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff40 expref: 28 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.447955:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:0.0:1782480911.447958:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782480911.447960:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55e800, rc 0) 00000100:00100000:0.0:1782480911.447987:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:11030:x1869066366176128:12345-192.168.201.58@tcp:101:bash.0 Request processed in 6543us (6755us total) trans 4294967473 rc 0/0 00000100:00100000:0.0:1782480911.447995:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:3.0:1782480911.455374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480911.455522:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366176512 00000100:00100000:0.0:1782480911.455534:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366176512 00000100:00100000:0.0:1782480911.455608:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 192 00000100:00100000:0.0:1782480911.455619:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:11030:x1869066366176512:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:0.0:1782480911.455959:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.455992:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.456004:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782480911.456061:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:0.0:1782480911.456086:0:6840:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000799fe7bf reply state 000000003c40c00d transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480911.456096:0:6840:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:0.0:1782480911.456145:0:6840:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:0.0:1782480911.456379:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fe680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11030:x1869066366176512:12345-192.168.201.58@tcp:36:bash.0 Request processed in 759us (1012us total) trans 4294967476 rc 0/0 00000100:00100000:0.0:1782480911.456387:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 192 00000020:00080000:0.0:1782480911.456392:0:6840:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1782480911.459624:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:2.0:1782480911.459977:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.459991:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.459999:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.460005:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480911.460010:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.460018:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.460040:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:2.0:1782480911.460043:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480911.460048:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.460065:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5dd0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480911.460864:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366176640 00000100:00100000:0.0:1782480911.460875:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366176640 00000100:00100000:0.0:1782480911.460981:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 193 00000100:00100000:0.0:1782480911.460991:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11030:x1869066366176640:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1782480911.461014:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480911.461034:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5dd7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff47 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.461105:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff47 expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.461118:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5dd7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff47 expref: 32 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.461149:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:0.0:1782480911.461152:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480911.461155:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b200, rc 0) 00000100:00100000:0.0:1782480911.461231:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11030:x1869066366176640:12345-192.168.201.58@tcp:101:bash.0 Request processed in 241us (1615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480911.461245:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 193 00000100:00100000:1.0:1782480911.464702:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480911.464856:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366176768 00000100:00100000:3.0:1782480911.464866:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366176768 00000100:00100000:3.0:1782480911.464940:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:3.0:1782480911.464951:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:11030:x1869066366176768:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1782480911.464969:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480911.464991:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006b32b645/0x4776e02a9acf5dde lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff4e expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480911.465017:0:6609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3e800d, atime: 0x6a3e800c, ctime: 0x6a3e800d, blocks: 0xb 00010000:00010000:3.0:1782480911.465038:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=442s v=(0 0) 00010000:00010000:3.0:1782480911.465042:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00080000:0.0:1782480911.465131:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1782480911.465230:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006b32b645/0x4776e02a9acf5dde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff4e expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.465262:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000006b32b645/0x4776e02a9acf5dde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff4e expref: 8 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.465276:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ac00, rc 0) 00000100:00100000:3.0:1782480911.465356:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:11030:x1869066366176768:12345-192.168.201.58@tcp:101:bash.0 Request processed in 407us (709us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480911.465364:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:1.0:1782480911.471916:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480911.472251:0:6614:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366176896 00000100:00100000:3.0:1782480911.472262:0:6614:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366176896 00002000:00010000:3.0:1782480911.472306:0:6614:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1782480911.472311:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7efe72300 with x1869066366176896 ext(0->18446744073709551615) 00002000:00010000:3.0:1782480911.472323:0:6614:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7efe72300. 00000100:00100000:3.0:1782480911.472362:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1782480911.472371:0:6614:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366176896:12345-192.168.201.58@tcp:10:bash.0 00002000:00010000:3.0:1782480911.472865:0:6614:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1782480911.472869:0:6614:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 1782480909 -> 1782480911 00002000:00010000:3.0:1782480911.472871:0:6614:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 1782480908 -> 1782480908 00002000:00010000:3.0:1782480911.472873:0:6614:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 1782480909 -> 1782480911 00002000:00010000:3.0:1782480911.472875:0:6614:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1782480911.472938:0:6614:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe72300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2350:x1869066366176896:12345-192.168.201.58@tcp:10:bash.0 Request processed in 568us (1031us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1782480911.472946:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00002000:00010000:3.0:1782480911.472949:0:6614:0:(ofd_dev.c:2825:ofd_punch_hpreq_check()) lustre-OST0000: refresh locks: 9663677440/5 (0->18446744073709551615) 00002000:00100000:3.0:1782480911.472951:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7efe72300 with x1869066366176896 ext(0->18446744073709551615) 00002000:00010000:3.0:1782480911.472955:0:6614:0:(ofd_dev.c:2830:ofd_punch_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7efe72300. 00000100:00100000:0.0:1782480911.567259:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480911.567402:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366177024 00000100:00100000:3.0:1782480911.567414:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366177024 00000100:00100000:3.0:1782480911.567471:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 194 00000100:00100000:3.0:1782480911.567481:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11510:x1869066366177024:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1782480911.567571:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5de5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.567601:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5de5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.567613:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5de5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.567629:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5dec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.567635:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.567641:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.567948:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.567958:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.567965:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480911.568006:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568017:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5de5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568023:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5de5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568041:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5de5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568047:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.568052:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5de5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568059:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5de5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568070:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480911.568074:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.568077:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5de5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568084:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5de5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568095:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5dec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568100:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5dec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568105:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568110:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.568113:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5dec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568127:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5dec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568135:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c51d1b00) 00010000:00010000:3.0:1782480911.568137:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.568140:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5dec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568145:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5dec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568161:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568167:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568173:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568177:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779bc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.568180:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568186:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568192:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:3.0:1782480911.568194:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.568196:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.568211:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5df3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480911.568301:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11510:x1869066366177024:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 819us (1048us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480911.568310:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 194 00000100:00100000:1.0:1782480911.619215:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480911.619566:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366177280 00000100:00100000:3.0:1782480911.619577:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366177280 00000100:00100000:3.0:1782480911.619689:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 195 00000100:00100000:3.0:1782480911.619702:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+32:11513:x1869066366177280:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480911.619727:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480911.619751:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5dfa lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff55 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.619847:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e01 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.619862:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.619873:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.619887:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e08 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.619894:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.619920:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621023:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5e0f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621040:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621049:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5e0f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480911.621352:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1782480911.621548:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e01 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621567:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e01 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621573:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621579:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.621584:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e01 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621592:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e01 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621606:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480911.621609:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.621625:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e01 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621631:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e01 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621885:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e08 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621894:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e08 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621900:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621905:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.621909:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e08 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621916:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e08 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621925:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c51d1b00) 00010000:00010000:3.0:1782480911.621928:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.621931:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e08 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621937:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e08 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.621994:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5dfa lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff55 expref: 35 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.622020:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5e0f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff55 expref: 34 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.622028:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:3.0:1782480911.622031:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782480911.622034:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a000, rc 0) 00000100:00100000:3.0:1782480911.622130:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe71880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:11513:x1869066366177280:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2430us (2925us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1782480911.622139:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 195 00000100:00100000:1.0:1782480911.631701:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480911.631918:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366177408 00000100:00100000:3.0:1782480911.631929:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366177408 00000100:00100000:3.0:1782480911.631980:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 196 00000100:00100000:3.0:1782480911.631990:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:11513:x1869066366177408:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:3.0:1782480911.632064:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.632080:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff40 expref: 34 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.632090:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.632126:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff40 expref: 34 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.632139:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff40 expref: 34 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480911.632362:0:6840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe8fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1869066388192512:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782480911.632577:0:6840:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495840 going to sleep for 11 seconds 00000100:00100000:0.0:1782480911.652623:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480911.652746:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366177664 00000100:00100000:1.0:1782480911.652776:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366177664 00000100:00100000:1.0:1782480911.652880:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:1.0:1782480911.652890:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:5567:x1869066366177664:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1782480911.654097:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:5567:x1869066366177664:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 1199us (1476us total) trans 4294967478 rc 0/0 00000100:00100000:1.0:1782480911.654111:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:3.0:1782480911.654829:0:6840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe8fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1869066388192512:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480911.654861:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480911.658065:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480911.658181:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366177792 00000100:00100000:2.0:1782480911.658191:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366177792 00010000:00010000:2.0:1782480911.658235:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff40 expref: 36 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480911.658320:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:2.0:1782480911.658330:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:2350:x1869066366177792:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480911.658346:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480911.658353:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff40 expref: 36 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.658365:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff40 expref: 36 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.658387:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5dc2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff40 expref: 36 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.658402:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:2.0:1782480911.658406:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.658415:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.658423:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.658458:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480911.658548:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:2350:x1869066366177792:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 218us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480911.658556:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 73 00010000:00010000:0.0:1782480911.659384:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.659396:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.659431:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.659438:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.659444:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.659450:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480911.659454:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.659461:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.659487:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:0.0:1782480911.659490:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480911.659494:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.659500:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b800/0x4776e02a9acf5e1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480911.659575:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:11513:x1869066366177408:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 27584us (27880us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480911.659585:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 196 00000100:00100000:1.0:1782480911.664034:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480911.664302:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366178048 00000100:00100000:2.0:1782480911.664314:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366178048 00000100:00100000:2.0:1782480911.664412:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:2.0:1782480911.664423:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+34:11513:x1869066366178048:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:2.0:1782480911.664706:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:11513:x1869066366178048:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 284us (679us total) trans 4294967479 rc 0/0 00000100:00100000:2.0:1782480911.664715:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000040:00080000:0.0:1782480911.711922:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480911.711935:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480911.711973:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1782480911.711981:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1782480911.752813:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480911.752923:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366178304 00000100:00100000:0.0:1782480911.752934:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366178304 00000100:00100000:0.0:1782480911.753066:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00100000:0.0:1782480911.753079:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+35:11524:x1869066366178304:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:0.0:1782480911.753111:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480911.753137:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e24 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff5c expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.753469:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e2b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.753490:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.753526:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.753544:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e32 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.753564:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.753571:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754333:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5e39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754347:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754355:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5e39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480911.754369:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:0.0:1782480911.754473:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e2b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754481:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e2b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754488:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754494:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480911.754505:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e2b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754512:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e2b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754526:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480911.754529:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480911.754533:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754539:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754625:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e32 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754632:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e32 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754638:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754920:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480911.754926:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e32 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754933:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e32 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754944:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c32f3000) 00010000:00010000:0.0:1782480911.754946:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480911.754960:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e32 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.754967:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e32 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.755035:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e24 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff5c expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.755066:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5e39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff5c expref: 37 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.755074:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:0.0:1782480911.755076:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1782480911.755078:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782480911.755160:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:11524:x1869066366178304:12345-192.168.201.58@tcp:101:cat.0 Request processed in 2083us (2528us total) trans 4294967480 rc 0/0 00000100:00100000:0.0:1782480911.755169:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00100000:0.0:1782480911.761334:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480911.761419:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366178560 00000100:00100000:1.0:1782480911.761431:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366178560 00000100:00100000:1.0:1782480911.761506:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:1.0:1782480911.761520:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:11524:x1869066366178560:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:1.0:1782480911.761886:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:11524:x1869066366178560:12345-192.168.201.58@tcp:35:cat.0 Request processed in 368us (563us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1782480911.761896:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 54 00000100:00100000:1.0:1782480911.783499:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480911.783590:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366178816 00000100:00100000:0.0:1782480911.783599:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366178816 00000100:00100000:0.0:1782480911.783702:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 198 00000100:00100000:0.0:1782480911.783714:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:11525:x1869066366178816:12345-192.168.201.58@tcp:36:rm.0 00010000:00010000:0.0:1782480911.783776:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1782480911.783814:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5e39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff5c expref: 38 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.783837:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a000/0x4776e02a9acf5e0f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff55 expref: 37 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.783873:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5dd7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff47 expref: 36 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.783883:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c51d1900) 00010000:00010000:0.0:1782480911.783897:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480911.783925:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e47 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.783940:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.783950:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.783963:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.783969:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.783975:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.784305:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e55 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.784314:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.784320:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782480911.784992:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].7, 64 off8712 00000004:00080000:0.0:1782480911.785003:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 442346343443ns, next at 443346340901ns, rc = 0 00010000:00010000:0.0:1782480911.785068:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785079:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785088:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785097:0:5803:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785104:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785109:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785138:0:5803:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782480911.785162:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e55 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785168:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e55 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785173:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785178:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480911.785192:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e55 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785200:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e55 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785211:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3600) 00010000:00010000:0.0:1782480911.785214:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1782480911.785218:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e55 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785225:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5e55 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785248:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e47 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785255:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e47 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785261:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785265:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480911.785267:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e47 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785273:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e47 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785280:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480911.785283:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480911.785292:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e47 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.785298:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e47 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480911.785310:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000002462bcdf reply state 00000000761053ab transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480911.785319:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480911.785407:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+37:11525:x1869066366178816:12345-192.168.201.58@tcp:36:rm.0 Request processed in 1691us (1913us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1782480911.785416:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 198 00010000:00010000:2.0:1782480911.785686:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480911.785693:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.785700:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782480911.785703:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.785710:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.785721:0:5790:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff91d7c32f3600) 00010000:00010000:2.0:1782480911.785724:0:5790:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782480911.785727:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.785733:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5e5c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.785749:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480911.785758:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480911.785760:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480911.791052:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.791076:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.791084:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.791091:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.791097:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.791106:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.791124:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c32f3000) 00010000:00010000:3.0:1782480911.791127:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.791132:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.791138:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5e4e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480911.854315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480911.854525:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366179072 00000100:00100000:3.0:1782480911.854535:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366179072 00000100:00100000:3.0:1782480911.854610:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 199 00000100:00100000:3.0:1782480911.854621:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+36:11531:x1869066366179072:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:3.0:1782480911.854655:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480911.854715:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5e63 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff63 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.854865:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e6a lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.854880:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.854891:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.854906:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.854913:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.854919:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782480911.855584:0:5802:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1782480911.855793:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.855828:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.855837:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.855879:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e6a lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.855887:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e6a lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.855893:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.855899:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.855904:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e6a lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.855910:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e6a lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.855922:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480911.855925:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.855929:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e6a lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.855935:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5e6a lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480911.855948:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000619e6149 reply state 000000009e70465d transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480911.855964:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1782480911.856002:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5e63 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff63 expref: 39 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.856018:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff63 expref: 38 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.856026:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:3.0:1782480911.856028:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480911.856031:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779ba00, rc 0) 00000100:00100000:3.0:1782480911.856104:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+39:11531:x1869066366179072:12345-192.168.201.58@tcp:101:bash.0 Request processed in 1485us (1799us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1782480911.856111:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 199 00010000:00010000:3.0:1782480911.861725:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.861743:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.861750:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.861756:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480911.861761:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.861769:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.861820:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c51d1b00) 00010000:00010000:3.0:1782480911.861824:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480911.861829:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480911.861835:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5e71 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480911.862079:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480911.862168:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366179200 00000100:00100000:0.0:1782480911.862179:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366179200 00000100:00100000:0.0:1782480911.862258:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:0.0:1782480911.862279:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366179200:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1782480911.862298:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480911.862317:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5e86 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff6a expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782480911.862344:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782480911.862366:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=442s v=(0 0) 00010000:00010000:0.0:1782480911.862371:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480911.862381:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5e86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff6a expref: 6 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.862555:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5e86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff6a expref: 6 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.862583:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b800, rc 0) 00000100:00100000:0.0:1782480911.862640:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2350:x1869066366179200:12345-192.168.201.58@tcp:101:bash.0 Request processed in 373us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480911.862649:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00080000:1.0:1782480911.862953:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480911.867793:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480911.867946:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366179328 00000100:00100000:1.0:1782480911.867957:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366179328 00000100:00100000:1.0:1782480911.868043:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:1.0:1782480911.868063:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:11531:x1869066366179328:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1782480911.868084:0:8498:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480911.868119:0:8498:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff71 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.868154:0:8498:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5e86 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff6a expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.868163:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480911.868167:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480911.868172:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 7 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.868214:0:8498:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5e86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff6a expref: 7 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480911.868245:0:8498:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5e86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff6a expref: 7 pid: 6608 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480911.868261:0:8498:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfa56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8498:1869066388192640:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480911.868689:0:8498:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c240 going to sleep for 11 seconds 00000100:00100000:1.0:1782480911.873610:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480911.874726:0:8498:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfa56d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:8498:1869066388192640:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480911.874773:0:8498:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 7 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480911.874920:0:8498:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55fe00, rc 0) 00000100:00100000:2.0:1782480911.875128:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:11531:x1869066366179328:12345-192.168.201.58@tcp:101:bash.0 Request processed in 7074us (7352us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480911.875139:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:3.0:1782480911.875955:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366179456 00000100:00100000:3.0:1782480911.875965:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366179456 00010000:00010000:0.0:1782480911.876965:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5e86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff6a expref: 7 pid: 6608 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480911.877006:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:0.0:1782480911.877016:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366179456:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480911.877032:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480911.877066:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5e86 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff6a expref: 7 pid: 6608 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.877080:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5e86 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff6a expref: 7 pid: 6608 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.877107:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf5e86 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff6a expref: 7 pid: 6608 timeout: 542 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.877130:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480911.877134:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480911.877143:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 6 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.877169:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 6 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480911.877211:0:5787:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 6 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480911.877227:0:5787:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6cad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5787:1869066388192768:192.168.201.58@tcp:105: 00000100:00100000:0.0:1782480911.877508:0:5787:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1782480911.883005:0:5787:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6cad80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5787:1869066388192768:192.168.201.58@tcp:105: 00010000:00010000:0.0:1782480911.883043:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480911.883114:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366179456:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 6098us (9513us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480911.883124:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 74 00000100:00100000:2.0:1782480911.886171:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480911.886344:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366179712 00000100:00100000:1.0:1782480911.886354:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366179712 00000100:00100000:1.0:1782480911.886536:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:1.0:1782480911.886559:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+38:11531:x1869066366179712:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:1.0:1782480911.887190:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+39:11531:x1869066366179712:12345-192.168.201.58@tcp:35:bash.0 Request processed in 641us (1026us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1782480911.887215:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 55 00000100:00100000:1.0:1782480912.111097:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.111178:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366179840 00000100:00100000:0.0:1782480912.111186:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366179840 00000100:00100000:0.0:1782480912.111253:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 200 00000100:00100000:0.0:1782480912.111332:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+39:11547:x1869066366179840:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480912.111359:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480912.111379:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e94 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff78 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.111438:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5e9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.111451:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.111478:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480912.111531:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1782480912.111533:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480912.111550:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5e9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.111574:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5e94 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff78 expref: 41 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.111596:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5e9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff78 expref: 40 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.111605:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480912.111607:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1782480912.111610:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b200, rc 0) 00000100:00100000:0.0:1782480912.111712:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f99f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+40:11547:x1869066366179840:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 449us (624us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.111719:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 200 00000100:00100000:2.0:1782480912.116917:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.117029:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366180096 00000100:00100000:3.0:1782480912.117040:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366180096 00000100:00100000:3.0:1782480912.117158:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 201 00000100:00100000:3.0:1782480912.117170:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+40:11547:x1869066366180096:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480912.117194:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480912.117217:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ea2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff7f expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.117344:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5ea9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.117358:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.117368:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5ea9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480912.117380:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1782480912.117518:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ea2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff7f expref: 43 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.117558:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5ea9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff7f expref: 42 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.117567:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:3.0:1782480912.117571:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480912.117574:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779bc00, rc 0) 00000100:00100000:3.0:1782480912.117651:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+42:11547:x1869066366180096:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 474us (735us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1782480912.117715:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 201 00000100:00100000:1.0:1782480912.123145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480912.123176:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.123401:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366180480 00000100:00100000:0.0:1782480912.123416:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366180480 00000100:00100000:0.0:1782480912.123477:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 202 00000100:00100000:0.0:1782480912.123488:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+42:11547:x1869066366180480:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480912.123517:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480912.123538:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5eb7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff86 expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.123689:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ebe lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.123704:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.123715:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ebe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480912.123727:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:0.0:1782480912.123873:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5eb7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff86 expref: 45 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.123895:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff86 expref: 44 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.123904:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:0.0:1782480912.123907:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1782480912.123911:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:2.0:1782480912.123974:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366180224 00000100:00100000:0.0:1782480912.123976:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+44:11547:x1869066366180480:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 490us (797us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1782480912.123978:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366180224 00000100:00100000:0.0:1782480912.123983:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 202 00000100:00100000:0.0:1782480912.124791:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:0.0:1782480912.124817:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+44:2350:x1869066366180224:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480912.124830:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480912.124848:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5ea9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff7f expref: 44 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.124877:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:0.0:1782480912.124881:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480912.124916:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10f3050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+43:2350:x1869066366180224:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 104us (1779us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.124923:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:1.0:1782480912.133134:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.133243:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366180608 00000100:00100000:0.0:1782480912.133255:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366180608 00000100:00100000:0.0:1782480912.133417:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:0.0:1782480912.133431:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+6:2351:x1869066366180608:12345-192.168.201.58@tcp:1:lfs.0 00010000:00010000:0.0:1782480912.133491:0:6608:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.133513:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 6 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.133522:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480912.133526:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480912.133531:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.133811:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 6 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.133826:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 6 pid: 8498 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.133870:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1869066388192896:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480912.133976:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f540 going to sleep for 11 seconds 00000100:00100000:1.0:1782480912.137350:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.137409:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366180736 00000100:00100000:3.0:1782480912.137420:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366180736 00000100:00100000:0.0:1782480912.137463:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6cad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6608:1869066388192896:192.168.201.58@tcp:104: 00002000:00100000:3.0:1782480912.137479:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91d8006bdf80 x1869066366180736/t0(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:668/0 lens 504/0 e 0 to 0 dl 1782480923 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480912.137489:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d8006bdf80 with x1869066366180736 ext(0->8) 00010000:00010000:0.0:1782480912.137494:0:6608:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.137496:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 7 pid: 8498 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.137512:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 7 pid: 8498 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480912.137520:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d8006bdf80 00000100:00100000:3.0:1782480912.137553:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:3.0:1782480912.137563:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366180736:12345-192.168.201.58@tcp:4:lfs.0 00000100:00100000:3.0:1782480912.138118:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2350:x1869066366180736:12345-192.168.201.58@tcp:4:lfs.0 Request processed in 554us (777us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1782480912.138143:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00002000:00100000:3.0:1782480912.138151:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff91d8006bdf80 x1869066366180736/t4294967308(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:668/0 lens 504/448 e 0 to 0 dl 1782480923 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480912.138159:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d8006bdf80 with x1869066366180736 ext(0->8) 00010000:00010000:3.0:1782480912.138165:0:6612:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 9 pid: 8498 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.138178:0:6612:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 9 pid: 8498 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480912.138185:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 1 locks timeout for req ffff91d8006bdf80 00000100:00100000:1.0:1782480912.141970:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.142121:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366180864 00000100:00100000:0.0:1782480912.142135:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366180864 00010000:00010000:0.0:1782480912.142193:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 9 pid: 8498 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.142285:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 75 00000100:00100000:0.0:1782480912.142296:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2351:x1869066366180864:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480912.142315:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1782480912.142342:0:5787:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1782480912.142345:0:5787:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1782480912 00002000:00010000:0.0:1782480912.142347:0:5787:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1782480912 00002000:00010000:0.0:1782480912.142349:0:5787:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1782480912 00010000:00010000:0.0:1782480912.142355:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 9 pid: 8498 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.142370:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 9 pid: 8498 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.142414:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e226b63/0x4776e02a9acf5e8d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff71 expref: 9 pid: 8498 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.142433:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480912.142438:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480912.142443:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.142452:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.142493:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480912.142575:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2351:x1869066366180864:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 280us (615us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.142583:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 75 00010000:00010000:1.0:1782480912.142649:0:6608:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.142677:0:6608:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.142713:0:6608:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.142722:0:6608:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.142730:0:6608:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.142737:0:6608:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782480912.142742:0:6608:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.142762:0:6608:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.142774:0:6608:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.142783:0:6608:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006cfaf765/0x4776e02a9acf5ecc lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.142865:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366180608:12345-192.168.201.58@tcp:1:lfs.0 Request processed in 9436us (9741us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480912.142873:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:1.0:1782480912.148917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.152884:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366181120 00000100:00100000:0.0:1782480912.152903:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366181120 00000100:00100000:1.0:1782480912.153137:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 56 00000100:00100000:1.0:1782480912.153150:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+43:11547:x1869066366181120:12345-192.168.201.58@tcp:35:lfs.0 00000004:00010000:1.0:1782480912.153246:0:5806:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ebe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff86 expref: 43 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782480912.153526:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1782480912.153588:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1782480912.154078:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1782480912.154145:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.154165:0:5806:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff63 expref: 47 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.154197:0:5806:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.154239:0:5806:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff63 expref: 47 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.154257:0:5806:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff63 expref: 47 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.154273:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfab2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1869066388193024:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480912.154375:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c77e4600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480912.158260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.158381:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfab2a00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5806:1869066388193024:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480912.158411:0:5806:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480912.158452:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366181248 00000100:00100000:2.0:1782480912.158461:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366181248 00010000:00010000:2.0:1782480912.158499:0:5786:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff63 expref: 48 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480912.158538:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:1.0:1782480912.158544:0:5788:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1782480912.158548:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+48:2351:x1869066366181248:12345-192.168.201.58@tcp:103:ldlm_bl.0 00000100:00100000:1.0:1782480912.158564:0:5788:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:2.0:1782480912.158566:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480912.158574:0:5786:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff63 expref: 48 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.158587:0:5786:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff63 expref: 48 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.158632:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5e78 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff63 expref: 48 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.158649:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:2.0:1782480912.158654:0:5786:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.158715:0:5786:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.158722:0:5786:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.158740:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480912.158808:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fea00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+47:2351:x1869066366181248:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 261us (559us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480912.158817:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00010000:00010000:3.0:1782480912.159581:0:5806:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.159594:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480912.159777:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:3.0:1782480912.160005:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:3.0:1782480912.160124:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe8fca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388193152:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1782480912.160183:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480912.160240:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480912.160627:0:5807:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388193152 00000100:00100000:2.0:1782480912.160636:0:5807:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388193152 00000100:00080000:0.0:1782480912.160824:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480912.167710:0:5807:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782480912.167738:0:5807:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869066388193152:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1782480912.167900:0:5807:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8ffb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5806:x1869066388193152:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 176us (7715us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.167924:0:5807:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480912.168009:0:5806:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967307 gen 2 00000004:00080000:1.0:1782480912.168016:0:5806:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967307 00000004:00080000:1.0:1782480912.168038:0:5806:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7dfa57800, transno 4294967307 00000100:00100000:1.0:1782480912.168055:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe8fca80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388193152:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1782480912.168525:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1782480912.168612:0:5806:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfab0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388193280:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782480912.168656:0:5806:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480912.172357:0:5806:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c240 going to sleep for 11 seconds 00000100:00100000:3.0:1782480912.174900:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388193280 00000100:00100000:3.0:1782480912.174914:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388193280 00000100:00100000:1.0:1782480912.175140:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782480912.175150:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5806:x1869066388193280:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1782480912.175472:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5806:x1869066388193280:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 321us (6814us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1782480912.175495:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782480912.176047:0:5806:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfab0a80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5806:1869066388193280:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1782480912.176133:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:3.0:1782480912.176201:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.176213:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.176221:0:5806:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.176228:0:5806:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480912.176233:0:5806:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.176242:0:5806:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.176259:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:3.0:1782480912.176263:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1782480912.176269:0:5806:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.176276:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5ed3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1782480912.176479:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:3.0:1782480912.176924:0:5806:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 64 off8512 00000004:00080000:3.0:1782480912.176938:0:5806:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 442738278200ns, next at 443738276245ns, rc = 0 00000001:00080000:3.0:1782480912.176947:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:3.0:1782480912.176987:0:5806:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c51d1600) 00010000:00010000:3.0:1782480912.176990:0:5806:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1782480912.176999:0:5806:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5ebe lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff86 expref: 51 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480912.177193:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b66850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+50:11547:x1869066366181120:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 24044us (28286us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1782480912.177203:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 56 00000020:00080000:3.0:1782480912.177207:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1782480912.180219:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.180325:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366181376 00000100:00100000:0.0:1782480912.180335:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366181376 00000100:00100000:0.0:1782480912.180426:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 203 00000100:00100000:0.0:1782480912.180438:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+50:11547:x1869066366181376:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480912.180462:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480912.180490:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5eda lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff8d expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.180567:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5eda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff8d expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.180882:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5eda lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff8d expref: 51 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.180907:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480912.180910:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480912.180914:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a200, rc 0) 00000100:00100000:0.0:1782480912.181029:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:11547:x1869066366181376:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 592us (818us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.181037:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 203 00000100:00100000:1.0:1782480912.185121:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.185259:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366181632 00000100:00100000:0.0:1782480912.185270:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366181632 00000100:00100000:0.0:1782480912.185329:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:0.0:1782480912.185339:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+51:11547:x1869066366181632:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1782480912.185603:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:11547:x1869066366181632:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 263us (488us total) trans 4294967496 rc 0/0 00000100:00100000:0.0:1782480912.185630:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 57 00000100:00100000:1.0:1782480912.279746:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.279893:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366181760 00000100:00100000:3.0:1782480912.279902:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366181760 00000100:00100000:3.0:1782480912.279954:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 204 00000100:00100000:3.0:1782480912.279961:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:11557:x1869066366181760:12345-192.168.201.58@tcp:34:lfs.0 00010000:00010000:3.0:1782480912.280028:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ee1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280041:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280050:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280063:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5ee8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280070:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280077:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280183:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280207:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280214:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1782480912.280256:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280270:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ee1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280277:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ee1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280295:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ee1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280300:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480912.280305:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ee1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280313:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ee1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280327:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480912.280331:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480912.280337:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ee1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280343:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5ee1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280364:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5ee8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280370:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5ee8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280376:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280381:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480912.280384:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5ee8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280390:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5ee8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280398:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c51d1600) 00010000:00010000:3.0:1782480912.280401:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480912.280403:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5ee8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280409:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5ee8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280425:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280429:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280433:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280440:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480912.280443:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280446:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280451:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480912.280452:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480912.280454:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.280457:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5eef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480912.280524:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:11557:x1869066366181760:12345-192.168.201.58@tcp:34:lfs.0 Request processed in 562us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480912.280530:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 204 00000100:00100000:1.0:1782480912.286840:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480912.286863:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388193408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480912.286863:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388193536:0@lo:400:kworker.0 00000100:00100000:3.0:1782480912.286982:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388193664:0@lo:400:kworker.0 00000100:00100000:2.0:1782480912.287013:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388193920:0@lo:400:kworker.0 00000100:00100000:1.0:1782480912.290528:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480912.290846:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388193792:0@lo:400:kworker.0 00000100:00100000:1.0:1782480912.290894:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480912.291180:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388193408 00000100:00100000:1.0:1782480912.291200:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388193408 00000100:00100000:1.0:1782480912.291287:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782480912.291297:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388193408:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480912.291325:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 52756480 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480912.291383:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388193408:12345-0@lo:13:osp-pre-1-0.0 Request processed in 87us (863us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480912.291390:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1782480912.291444:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfab0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388193408:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480912.292297:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480912.292351:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388194048:0@lo:400:kworker.0 00000100:00100000:0.0:1782480912.292389:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480912.292430:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388193792 00000100:00100000:0.0:1782480912.292436:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388193792 00000100:00100000:0.0:1782480912.292480:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388194048 00000100:00100000:0.0:1782480912.292484:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388194048 00000100:00100000:0.0:1782480912.292508:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782480912.292516:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388193792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480912.292564:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388193792:12345-0@lo:400:kworker.0 Request processed in 48us (1668us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.292569:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1782480912.292584:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1782480912.292590:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388194048:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480912.292621:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388194048:12345-0@lo:400:kworker.0 Request processed in 32us (231us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.292627:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00080000:0.0:1782480912.292643:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480912.292680:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388194048:0@lo:400:kworker.0 00000100:00100000:3.0:1782480912.292770:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480912.292802:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388193664 00000100:00100000:3.0:1782480912.292805:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388193664 00000100:00100000:3.0:1782480912.292831:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782480912.292837:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388193664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480912.292872:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388193664:12345-0@lo:400:kworker.0 Request processed in 35us (102us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480912.292877:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:3.0:1782480912.292904:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388193664:0@lo:400:kworker.0 00000100:00100000:1.0:1782480912.294831:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388193536 00000100:00100000:1.0:1782480912.294845:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388193536 00000100:00100000:1.0:1782480912.294917:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1782480912.294925:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388193536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480912.294994:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388193536:12345-0@lo:400:kworker.0 Request processed in 70us (2700us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480912.295001:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 306 00000100:00100000:1.0:1782480912.295126:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388193792:0@lo:400:kworker.0 00000100:00100000:0.0:1782480912.296046:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388193536:0@lo:400:kworker.0 00000100:00100000:2.0:1782480912.296322:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480912.300727:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388193920 00000100:00100000:3.0:1782480912.300740:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388193920 00000100:00100000:3.0:1782480912.300829:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1782480912.300840:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1869066388193920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480912.300951:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1869066388193920:12345-0@lo:400:kworker.0 Request processed in 113us (4629us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480912.300959:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1782480912.301442:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388193920:0@lo:400:kworker.0 00000100:00080000:0.0:1782480912.301526:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480912.331347:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.334036:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366182016 00000100:00100000:3.0:1782480912.334054:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366182016 00000100:00100000:3.0:1782480912.334141:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 205 00000100:00100000:3.0:1782480912.334153:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+52:11560:x1869066366182016:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480912.334184:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480912.334211:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5ef6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff94 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334300:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5efd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334316:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5efd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334328:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5efd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334343:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5f04 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334350:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5f04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334376:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5f04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334527:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334536:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334544:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480912.334554:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1782480912.334755:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5efd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334764:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5efd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334771:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5efd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334778:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480912.334781:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5efd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334788:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5efd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334833:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:3.0:1782480912.334836:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480912.334848:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5efd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334854:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf5efd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334868:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5f04 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334875:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5f04 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334881:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5f04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334887:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480912.334890:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5f04 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334896:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5f04 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334904:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c51d1600) 00010000:00010000:3.0:1782480912.334906:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480912.334909:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5f04 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334914:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf5f04 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334958:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5ef6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff94 expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334986:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff94 expref: 54 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.334993:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480912.334995:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480912.334997:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779bc00, rc 0) 00000100:00100000:3.0:1782480912.335071:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:11560:x1869066366182016:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 921us (3733us total) trans 4294967497 rc 0/0 00000100:00100000:3.0:1782480912.335086:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 205 00000100:00100000:1.0:1782480912.342222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.342342:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366182144 00000100:00100000:0.0:1782480912.342368:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366182144 00000100:00100000:0.0:1782480912.342465:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 206 00000100:00100000:0.0:1782480912.342475:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:11560:x1869066366182144:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:0.0:1782480912.342544:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.342562:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.342574:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.342602:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.342610:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f19 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.342616:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.342621:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480912.342625:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.342631:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f19 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.342642:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480912.342645:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782480912.342649:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f19 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.342717:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.342809:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:11560:x1869066366182144:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 334us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.342817:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 206 00000100:00100000:0.0:1782480912.345958:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480912.346040:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366182400 00000100:00100000:1.0:1782480912.346050:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366182400 00000100:00100000:1.0:1782480912.346109:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 58 00000100:00100000:1.0:1782480912.346125:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+54:11560:x1869066366182400:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:1.0:1782480912.346375:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:11560:x1869066366182400:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 252us (425us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1782480912.346382:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 58 00010000:00010000:0.0:1782480912.351045:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480912.412851:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.412973:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366182656 00000100:00100000:0.0:1782480912.412984:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366182656 00000100:00100000:0.0:1782480912.413052:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 207 00000100:00100000:0.0:1782480912.413063:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:11570:x1869066366182656:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1782480912.413089:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480912.413092:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1782480912.413130:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5e9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff78 expref: 55 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.413154:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480912.413159:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480912.413173:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f20 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ff9b expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.413294:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.413308:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff94 expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.413333:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.413365:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff94 expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.413377:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff94 expref: 55 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.413390:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388194176:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480912.413484:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f540 going to sleep for 11 seconds 00000100:00100000:0.0:1782480912.421248:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388194176:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480912.421413:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480912.423382:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.424522:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366182784 00000100:00100000:0.0:1782480912.424533:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366182784 00010000:00010000:0.0:1782480912.424588:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff94 expref: 56 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.424632:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:0.0:1782480912.424642:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+56:2351:x1869066366182784:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480912.424674:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480912.424681:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff94 expref: 56 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.424725:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff94 expref: 56 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.424750:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779bc00/0x4776e02a9acf5f0b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff94 expref: 56 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.424764:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480912.424769:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.424779:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.424786:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.424833:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480912.424879:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.424888:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.424896:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:2351:x1869066366182784:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 256us (1524us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.424903:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00000004:00200000:3.0:1782480912.424907:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1782480912.425069:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf5f20 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff9b expref: 56 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.425087:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff9b expref: 55 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.425094:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480912.425097:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1782480912.425105:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297be00, rc 0) 00000100:00100000:3.0:1782480912.425133:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:11570:x1869066366182656:12345-192.168.201.58@tcp:101:bash.0 Request processed in 12071us (12292us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1782480912.425141:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 207 00000100:00100000:2.0:1782480912.429512:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480912.429882:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366183040 00000100:00100000:1.0:1782480912.429891:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366183040 00000100:00100000:1.0:1782480912.429953:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 208 00000100:00100000:1.0:1782480912.429963:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+55:11570:x1869066366183040:12345-192.168.201.58@tcp:36:bash.0 00010000:00010000:1.0:1782480912.430246:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.430264:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.430276:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1782480912.430331:0:5804:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:1.0:1782480912.430355:0:5804:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000e37c00a2 reply state 00000000890d2298 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.430385:0:5804:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782480912.430488:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+58:11570:x1869066366183040:12345-192.168.201.58@tcp:36:bash.0 Request processed in 524us (986us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1782480912.430496:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 208 00000020:00080000:1.0:1782480912.430501:0:5804:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1782480912.434386:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1782480912.434467:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.434479:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.434487:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.434492:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480912.434498:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.434505:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.434523:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480912.434526:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480912.434529:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.434535:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf5f35 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.435349:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366183168 00000100:00100000:1.0:1782480912.435365:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366183168 00000100:00100000:1.0:1782480912.435438:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:1.0:1782480912.435448:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+57:11570:x1869066366183168:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:1.0:1782480912.435474:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480912.435495:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5f3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffa2 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.435589:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.435606:0:6840:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff9b expref: 58 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.435615:0:6840:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.436016:0:6840:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff9b expref: 58 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.436031:0:6840:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff9b expref: 58 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.436138:0:6840:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfab3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1869066388194304:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480912.436294:0:6840:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057c240 going to sleep for 11 seconds 00000100:00100000:1.0:1782480912.444145:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.444502:0:6840:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfab3480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6840:1869066388194304:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480912.444535:0:6840:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.445514:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366183296 00000100:00100000:0.0:1782480912.445524:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366183296 00010000:00010000:0.0:1782480912.445565:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff9b expref: 59 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.445611:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:0.0:1782480912.445620:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:2350:x1869066366183296:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480912.445646:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480912.445654:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 1s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff9b expref: 59 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.445703:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff9b expref: 59 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.445726:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf5f27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff9b expref: 59 pid: 5802 timeout: 542 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.445745:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480912.445751:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.445761:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.445767:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.445799:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480912.445817:0:6840:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.445824:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.445864:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+58:2350:x1869066366183296:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 245us (1732us total) trans 0 rc 0/0 00000004:00200000:3.0:1782480912.445872:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00100000:0.0:1782480912.445872:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00000004:00200000:3.0:1782480912.445876:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480912.445900:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.445932:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf5f3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa2 expref: 58 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.445947:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa2 expref: 57 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.445955:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480912.445958:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480912.445960:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55e800, rc 0) 00000100:00100000:3.0:1782480912.445987:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+57:11570:x1869066366183168:12345-192.168.201.58@tcp:101:bash.0 Request processed in 10541us (11612us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480912.445993:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 209 00000100:00100000:2.0:1782480912.449307:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.449424:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366183552 00000100:00100000:0.0:1782480912.449435:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366183552 00000100:00100000:0.0:1782480912.449497:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:0.0:1782480912.449508:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+57:11570:x1869066366183552:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:0.0:1782480912.450039:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+58:11570:x1869066366183552:12345-192.168.201.58@tcp:35:bash.0 Request processed in 531us (740us total) trans 4294967502 rc 0/0 00000100:00100000:0.0:1782480912.450047:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 59 00000100:00100000:2.0:1782480912.515445:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480912.515554:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366183680 00000100:00100000:1.0:1782480912.515565:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366183680 00000100:00100000:1.0:1782480912.515627:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 210 00000100:00100000:1.0:1782480912.515648:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+58:11576:x1869066366183680:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782480912.515722:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480912.515745:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5f4a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffa9 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.515828:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5f51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.515845:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.515858:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480912.515925:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1782480912.515929:0:5804:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480912.515955:0:5804:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5f51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.515981:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5f4a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa9 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.516020:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5f51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa9 expref: 59 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.516029:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:1.0:1782480912.516033:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782480912.516037:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55fa00, rc 0) 00000100:00100000:1.0:1782480912.516098:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:11576:x1869066366183680:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 462us (668us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480912.516105:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 210 00000100:00100000:1.0:1782480912.523374:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.523522:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366183808 00000100:00100000:3.0:1782480912.523533:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366183808 00000100:00100000:3.0:1782480912.523989:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:3.0:1782480912.524000:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:11576:x1869066366183808:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:3.0:1782480912.524022:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480912.524070:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5f58 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffb0 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524455:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5f5f lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524483:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5f5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524495:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5f5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524512:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf5f66 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524520:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf5f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524527:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf5f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524678:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5f6d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524692:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524698:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480912.524736:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1782480912.524740:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480912.524759:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524770:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5f6d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524798:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5f5f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524804:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5f5f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524810:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5f5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524815:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2cc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480912.524819:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5f5f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524825:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5f5f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524837:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:2.0:1782480912.524840:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480912.524844:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5f5f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524850:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2cc00/0x4776e02a9acf5f5f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524863:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf5f66 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524869:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf5f66 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524875:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf5f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524886:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2c400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480912.524888:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf5f66 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524894:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf5f66 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524901:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c610ba00) 00010000:00010000:2.0:1782480912.524903:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782480912.524906:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf5f66 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524911:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf5f66 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524944:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779ba00/0x4776e02a9acf5f58 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb0 expref: 61 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524957:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5f6d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb0 expref: 60 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.524964:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:2.0:1782480912.524967:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782480912.524969:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2c200, rc 0) 00000100:00100000:2.0:1782480912.525218:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:11576:x1869066366183808:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1220us (1856us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480912.525224:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 211 00000100:00100000:2.0:1782480912.539748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480912.539816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480912.539941:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366184192 00000100:00100000:0.0:1782480912.539941:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366183936 00000100:00100000:1.0:1782480912.539951:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366184192 00000100:00100000:0.0:1782480912.539951:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366183936 00000100:00100000:1.0:1782480912.540009:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:0.0:1782480912.540011:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1782480912.540019:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:11576:x1869066366184192:12345-192.168.201.58@tcp:101:lfs.0 00000100:00100000:0.0:1782480912.540019:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:2351:x1869066366183936:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480912.540038:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480912.540044:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480912.540068:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf5f6d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb0 expref: 61 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.540075:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5f74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffb7 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.540089:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480912.540094:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480912.540163:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:2351:x1869066366183936:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 146us (426us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.540171:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00010000:00010000:1.0:1782480912.540175:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.540187:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa2 expref: 60 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.540197:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.540243:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa2 expref: 60 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.540257:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa2 expref: 60 pid: 6840 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.540273:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfab1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388194432:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480912.540354:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d80057cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1782480912.543547:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfab1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388194432:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480912.543591:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480912.546544:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.546968:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366184320 00000100:00100000:0.0:1782480912.546986:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366184320 00010000:00010000:0.0:1782480912.547033:0:5788:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa2 expref: 61 pid: 6840 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.547066:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:0.0:1782480912.547076:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:2350:x1869066366184320:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480912.547092:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480912.547098:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa2 expref: 61 pid: 6840 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.547268:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa2 expref: 61 pid: 6840 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.547293:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf5f43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa2 expref: 61 pid: 6840 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.547311:0:5788:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480912.547316:0:5788:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.547327:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.547336:0:5788:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.547370:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480912.547451:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:2350:x1869066366184320:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 375us (920us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.547460:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00010000:00010000:1.0:1782480912.547534:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.547544:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480912.547568:0:5804:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782480912.547800:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5f74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb7 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.547817:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb7 expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.547825:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:1.0:1782480912.547827:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782480912.547839:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55fe00, rc 0) 00000100:00100000:1.0:1782480912.547869:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:11576:x1869066366184192:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 7852us (8053us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1782480912.547878:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 212 00000100:00100000:0.0:1782480912.551545:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480912.552211:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366184576 00000100:00100000:2.0:1782480912.552226:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366184576 00000100:00100000:2.0:1782480912.552338:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1782480912.552349:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:11576:x1869066366184576:12345-192.168.201.58@tcp:103:lfs.0 00010000:00010000:2.0:1782480912.552369:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480912.552400:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5eda lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff8d expref: 60 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.552421:0:5786:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:2.0:1782480912.552427:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480912.552495:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:11576:x1869066366184576:12345-192.168.201.58@tcp:103:lfs.0 Request processed in 148us (967us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480912.552504:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1782480912.558943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480912.559019:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366184704 00000100:00100000:1.0:1782480912.559027:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366184704 00000100:00100000:1.0:1782480912.559077:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:1.0:1782480912.559087:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:11576:x1869066366184704:12345-192.168.201.58@tcp:58:lfs.0 00010000:00010000:1.0:1782480912.559206:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.559219:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.559227:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480912.559387:0:6840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1782480912.559462:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:11576:x1869066366184704:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 376us (527us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480912.559468:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 213 00000100:00100000:1.0:1782480912.564499:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.564572:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366184832 00000100:00100000:0.0:1782480912.564583:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366184832 00000100:00100000:0.0:1782480912.564648:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 214 00000100:00100000:0.0:1782480912.564679:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+59:11576:x1869066366184832:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782480912.564812:0:5803:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480912.564832:0:5803:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5f90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffbe expref: -99 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.564907:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.564916:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5f90 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffbe expref: 60 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.564931:0:5803:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.564941:0:5803:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5f90 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffbe expref: 60 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.564952:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480912.564954:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480912.564957:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5f90 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffbe expref: 60 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.564963:0:5803:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782480912.565047:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:11576:x1869066366184832:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 391us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.565052:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 214 00000040:00080000:0.0:1782480912.734956:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480912.734966:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480912.735005:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1782480912.735012:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480912.735142:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388194560:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782480912.735263:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f480 going to sleep for 11 seconds 00000100:00100000:0.0:1782480912.744438:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388194560:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1782480912.747281:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480912.751959:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366184960 00000100:00100000:1.0:1782480912.751977:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366184960 00000100:00100000:1.0:1782480912.752066:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00100000:1.0:1782480912.752079:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:11577:x1869066366184960:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782480912.752144:0:6840:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782480912.752325:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:11577:x1869066366184960:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 248us (5053us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480912.752344:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 215 00000100:00100000:1.0:1782480912.775063:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.775178:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366185088 00000100:00100000:0.0:1782480912.775188:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366185088 00000100:00100000:0.0:1782480912.775252:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:0.0:1782480912.775263:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:11577:x1869066366185088:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1782480912.775350:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5f97 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775367:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5f97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775378:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5f97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775395:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5f9e lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775401:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5f9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775407:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5f9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775428:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775436:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775442:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782480912.775504:0:5803:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1782480912.775508:0:5803:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782480912.775520:0:5803:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775531:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5f97 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775537:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5f97 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775543:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5f97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775549:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480912.775553:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5f97 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775574:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5f97 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775588:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:0.0:1782480912.775591:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480912.775596:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5f97 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775601:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5f97 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775618:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5f9e lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775646:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5f9e lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775651:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5f9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.775656:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480912.776002:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5f9e lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.776012:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5f9e lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.776020:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff91d7c32f3200) 00010000:00010000:0.0:1782480912.776023:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480912.776026:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5f9e lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.776032:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5f9e lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.776048:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.776055:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.776061:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.776066:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480912.776075:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.776081:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.776089:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480912.776092:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480912.776095:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.776101:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fa5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.776177:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:11577:x1869066366185088:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 915us (1123us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.776186:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 216 00000100:00100000:2.0:1782480912.780503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480912.780585:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366185344 00000100:00100000:1.0:1782480912.780595:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366185344 00000100:00100000:1.0:1782480912.780702:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:1.0:1782480912.780713:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+60:11577:x1869066366185344:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480912.780734:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480912.780754:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5fac lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffc5 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.780870:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.780885:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.780897:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480912.780910:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782480912.781013:0:6840:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.781021:0:6840:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.781028:0:6840:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.781034:0:6840:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ea00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480912.781051:0:6840:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.781059:0:6840:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.781072:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:1.0:1782480912.781075:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1782480912.781081:0:6840:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.781088:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.781128:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5fac lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffc5 expref: 62 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.781136:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:1.0:1782480912.781138:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480912.781141:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5fac lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffc5 expref: 62 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.781151:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55e000, rc 0) 00000100:00100000:1.0:1782480912.781209:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:11577:x1869066366185344:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 498us (717us total) trans 4294967504 rc 301/301 00000100:00100000:1.0:1782480912.781216:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 217 00000100:00100000:3.0:1782480912.789105:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.789201:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366185472 00000100:00100000:0.0:1782480912.789210:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366185472 00000100:00100000:0.0:1782480912.789272:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:0.0:1782480912.789283:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:11577:x1869066366185472:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1782480912.789321:0:5803:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1782480912.789428:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:11577:x1869066366185472:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 147us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.789517:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 218 00000100:00100000:2.0:1782480912.797547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480912.797691:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366185728 00000100:00100000:1.0:1782480912.797701:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366185728 00000100:00100000:1.0:1782480912.797754:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:1.0:1782480912.797764:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:11577:x1869066366185728:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480912.797809:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480912.797813:0:6840:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1782480912.797842:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fa00/0x4776e02a9acf5f51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffa9 expref: 61 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.797867:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:1.0:1782480912.797872:0:6840:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480912.797887:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5fc1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffcc expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1782480912.799276:0:6840:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x6:0x0], index 0: 0 00010000:00010000:1.0:1782480912.799493:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fc8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.799508:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.799518:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fc8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.799576:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e000/0x4776e02a9acf5fc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffcc expref: 63 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.799592:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fc8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffcc expref: 62 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.799600:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c8d19a00) 00010000:00010000:1.0:1782480912.799603:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480912.799616:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55ea00, rc 0) 00000100:00100000:1.0:1782480912.800124:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+62:11577:x1869066366185728:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 2359us (2599us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1782480912.800135:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 219 00000100:00100000:3.0:1782480912.809754:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.809862:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366185984 00000100:00100000:0.0:1782480912.809872:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366185984 00000100:00100000:0.0:1782480912.809939:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:0.0:1782480912.809949:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+62:11577:x1869066366185984:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782480912.810027:0:5803:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480912.810064:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ea00/0x4776e02a9acf5fc8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffcc expref: 62 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810087:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c8d19a00) 00010000:00010000:0.0:1782480912.810099:0:5803:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480912.810121:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fd6 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810134:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810143:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810158:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5fdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xc3a22634 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810165:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5fdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc3a22634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810172:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5fdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc3a22634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810253:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fd6 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810261:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fd6 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810267:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810281:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480912.810286:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fd6 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810292:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fd6 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810301:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480912.810303:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480912.810307:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fd6 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810314:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a200/0x4776e02a9acf5fd6 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810324:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5fdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xc3a22634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810329:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5fdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc3a22634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810335:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5fdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc3a22634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810341:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480912.810344:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5fdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc3a22634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810350:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5fdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xc3a22634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810372:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xc3a22634 (ffff91d7c32f3200) 00010000:00010000:0.0:1782480912.810374:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782480912.810377:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5fdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc3a22634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.810382:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5fdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xc3a22634 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.810462:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:11577:x1869066366185984:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 514us (720us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782480912.810469:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 220 00000100:00100000:3.0:1782480912.813897:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.813994:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366186112 00000100:00100000:0.0:1782480912.814004:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366186112 00000100:00100000:0.0:1782480912.814064:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 221 00000100:00100000:0.0:1782480912.814074:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+61:11577:x1869066366186112:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480912.814095:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480912.814119:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5fe4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffd3 expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.814156:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.814171:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.814181:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.814287:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5fe4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffd3 expref: 63 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.814316:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffd3 expref: 62 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.814326:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480912.814329:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1782480912.814332:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b200, rc 0) 00000100:00100000:0.0:1782480912.814397:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8ff480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+62:11577:x1869066366186112:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 323us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.814405:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 221 00000100:00100000:1.0:1782480912.819409:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.821177:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366186368 00000100:00100000:0.0:1782480912.821201:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366186368 00000100:00100000:0.0:1782480912.821474:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00100000:0.0:1782480912.821491:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+62:11577:x1869066366186368:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782480912.821588:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.821604:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.821616:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782480912.821919:0:5803:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].8, 88 off8800 00000004:00080000:0.0:1782480912.821928:0:5803:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 443383268358ns, next at 444383266577ns, rc = 0 00000004:00010000:0.0:1782480912.822012:0:5803:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000099ad841f reply state 00000000c67f1d27 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.822036:0:5803:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480912.822390:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+64:11577:x1869066366186368:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 901us (2988us total) trans 4294967506 rc 0/0 00000100:00100000:0.0:1782480912.822397:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 222 00000100:00100000:3.0:1782480912.828726:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:2.0:1782480912.828813:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.828826:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.828834:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.828841:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782480912.828846:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.828875:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.828889:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:2.0:1782480912.828892:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1782480912.828895:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480912.828899:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf5ff2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.828963:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366186496 00000100:00100000:0.0:1782480912.828972:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366186496 00000100:00100000:0.0:1782480912.829018:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 223 00000100:00100000:0.0:1782480912.829027:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+63:11577:x1869066366186496:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480912.829052:0:5804:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480912.829069:0:5804:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5ff9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffda expref: -99 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.829125:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5ff9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffda expref: 64 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.829138:0:5804:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5ff9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffda expref: 64 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.829156:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480912.829159:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480912.829162:0:5804:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b800, rc 0) 00000100:00100000:0.0:1782480912.829223:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+64:11577:x1869066366186496:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 196us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.829230:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 223 00000100:00100000:3.0:1782480912.835210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480912.835301:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366186624 00000100:00100000:2.0:1782480912.835311:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366186624 00000100:00100000:2.0:1782480912.835375:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:2.0:1782480912.835386:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2351:x1869066366186624:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782480912.835746:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:2351:x1869066366186624:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 361us (546us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1782480912.835754:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:1.0:1782480912.839052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.839147:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366186880 00000100:00100000:3.0:1782480912.839157:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366186880 00000100:00100000:3.0:1782480912.839223:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:3.0:1782480912.839233:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+64:11577:x1869066366186880:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782480912.839512:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+65:11577:x1869066366186880:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 279us (468us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1782480912.839519:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 60 00000100:00100000:3.0:1782480912.843609:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480912.843838:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366187136 00000100:00100000:2.0:1782480912.843848:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366187136 00000100:00100000:2.0:1782480912.843913:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:2.0:1782480912.843923:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+65:11577:x1869066366187136:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782480912.844040:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+65:11577:x1869066366187136:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 118us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480912.844048:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 224 00000100:00100000:1.0:1782480912.847726:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.847913:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366187264 00000100:00100000:3.0:1782480912.847924:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366187264 00000100:00100000:3.0:1782480912.847983:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 225 00000100:00100000:3.0:1782480912.847994:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+65:11577:x1869066366187264:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480912.848014:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480912.848034:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6000 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffe1 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.848102:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6007 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.848130:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.848141:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782480912.848188:0:6840:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782480912.848207:0:6840:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6007 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.848232:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6000 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe1 expref: 67 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.848249:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6007 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe1 expref: 66 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.848258:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:3.0:1782480912.848260:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782480912.848263:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a200, rc 0) 00000100:00100000:3.0:1782480912.848327:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+66:11577:x1869066366187264:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 335us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480912.848334:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 225 00000100:00100000:1.0:1782480912.855450:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.855641:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366187392 00000100:00100000:3.0:1782480912.855652:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366187392 00000100:00100000:3.0:1782480912.855738:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:3.0:1782480912.855748:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+10:2350:x1869066366187392:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782480912.855767:0:6609:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480912.855811:0:6609:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf600e lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffe8 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782480912.855840:0:6609:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e8011, blocks: 0x1 00010000:00010000:3.0:1782480912.855861:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=443s v=(0 0) 00010000:00010000:3.0:1782480912.855865:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782480912.855873:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf600e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe8 expref: 11 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.855891:0:6609:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf600e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe8 expref: 11 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.855905:0:6609:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b600, rc 0) 00000100:00100000:3.0:1782480912.855974:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+11:2350:x1869066366187392:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 227us (533us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480912.855980:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:2.0:1782480912.859387:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.859483:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366187648 00000100:00100000:0.0:1782480912.859492:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366187648 00000100:00100000:0.0:1782480912.859576:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:0.0:1782480912.859586:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+66:11577:x1869066366187648:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782480912.859742:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+66:11577:x1869066366187648:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 157us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.859750:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 226 00000100:00100000:1.0:1782480912.863715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.865321:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366187776 00000100:00100000:0.0:1782480912.865335:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366187776 00000100:00100000:0.0:1782480912.865410:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:0.0:1782480912.865421:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+11:11577:x1869066366187776:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782480912.865442:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480912.865462:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99ffef expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.865496:0:6608:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf600e lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe8 expref: 12 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.865505:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480912.865509:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480912.865515:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.865559:0:6608:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf600e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe8 expref: 12 pid: 6609 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.865575:0:6608:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf600e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe8 expref: 12 pid: 6609 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.865609:0:6608:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6608:1869066388194688:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480912.865990:0:6608:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f9c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480912.875010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.875405:0:6608:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6608:1869066388194688:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480912.875443:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 12 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.875465:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a200, rc 0) 00000100:00100000:0.0:1782480912.875540:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:11577:x1869066366187776:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 10112us (11826us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.875556:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:1.0:1782480912.875848:0:12358:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366187904 00000100:00100000:1.0:1782480912.875856:0:12358:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366187904 00010000:00010000:1.0:1782480912.875888:0:12358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf600e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe8 expref: 12 pid: 6609 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.875924:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:1.0:1782480912.875934:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:2351:x1869066366187904:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480912.875948:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480912.875971:0:5788:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf600e lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe8 expref: 12 pid: 6609 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.875984:0:5788:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf600e lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe8 expref: 12 pid: 6609 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.876007:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf600e lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe8 expref: 12 pid: 6609 timeout: 543 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.876019:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480912.876030:0:5788:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480912.876038:0:5788:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.876049:0:5788:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.876102:0:5788:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 11 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.876117:0:5788:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfab2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5788:1869066388194816:192.168.201.58@tcp:105: 00000100:00100000:1.0:1782480912.876904:0:5788:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96840 going to sleep for 11 seconds 00000100:00100000:2.0:1782480912.888396:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.888555:0:6614:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366188032 00000100:00100000:3.0:1782480912.888564:0:6614:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366188032 00002000:00100000:3.0:1782480912.888617:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff91d7df4a4000 x1869066366188032/t0(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:668/0 lens 504/0 e 0 to 0 dl 1782480923 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480912.888635:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7df4a4000 with x1869066366188032 ext(0->12) 00002000:00010000:3.0:1782480912.888642:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7df4a4000 00000100:00100000:3.0:1782480912.888695:0:6614:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:3.0:1782480912.888705:0:6614:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+12:2351:x1869066366188032:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1782480912.889251:0:6614:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:2351:x1869066366188032:12345-192.168.201.58@tcp:4:lhsmtool_posix.0 Request processed in 477us (796us total) trans 4294967320 rc 0/0 00000100:00100000:3.0:1782480912.889268:0:6614:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00002000:00100000:3.0:1782480912.889275:0:6614:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x6:0x0] (0->12) req@ffff91d7df4a4000 x1869066366188032/t4294967320(0) o4->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:668/0 lens 504/448 e 0 to 0 dl 1782480923 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480912.889284:0:6614:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7df4a4000 with x1869066366188032 ext(0->12) 00002000:00010000:3.0:1782480912.889288:0:6614:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7df4a4000 00000100:00100000:2.0:1782480912.893189:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.893331:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366188160 00000100:00100000:3.0:1782480912.893341:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366188160 00000100:00100000:3.0:1782480912.893403:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 227 00000100:00100000:3.0:1782480912.893413:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+66:11577:x1869066366188160:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1782480912.894840:0:5788:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfab2a00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5788:1869066388194816:192.168.201.58@tcp:105: 00010000:00010000:1.0:1782480912.894867:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480912.894924:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:2351:x1869066366187904:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 18990us (19921us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480912.894934:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:3.0:1782480912.941116:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+66:11577:x1869066366188160:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 47693us (47935us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480912.941130:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 227 00000001:00080000:2.0:1782480912.941202:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:2.0:1782480912.941209:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 8 committed 00000004:00080000:2.0:1782480912.941239:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 7 committed 00000020:00080000:2.0:1782480912.941272:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d7c77e49c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:2.0:1782480912.941277:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4a58200 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d7c77e4cc0 00000020:00080000:2.0:1782480912.941281:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4a58300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d7ecebdc00 00000020:00080000:2.0:1782480912.941714:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d7c622e480 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:2.0:1782480912.941719:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4a58d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d7c6478d80 00000020:00080000:2.0:1782480912.941722:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4a58500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d7c922a800 00000001:00080000:2.0:1782480912.941744:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:2.0:1782480912.941753:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1782480912.942404:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:0.0:1782480912.943127:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480912.943149:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388194944:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1782480912.943222:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480912.943265:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388195200:0@lo:2:osp-syn-0-0.0 00000100:00100000:0.0:1782480912.943295:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480912.943322:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388194944 00000100:00100000:0.0:1782480912.943329:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388194944 00000100:00100000:0.0:1782480912.943373:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388195200 00000100:00100000:0.0:1782480912.943376:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388195200 00000100:00100000:0.0:1782480912.943399:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782480912.943407:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fecc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388194944:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1782480912.943434:0:8498:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00000020:00080000:3.0:1782480912.943874:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:3.0:1782480912.943893:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782480912.943902:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1869066388195200:12345-0@lo:2:osp-syn-0-0.0 00000100:00100000:1.0:1782480912.943921:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388195072:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1782480912.943959:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00002000:00010000:3.0:1782480912.944050:0:6609:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1782480912.944054:0:6609:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1782480913 00002000:00010000:3.0:1782480912.944057:0:6609:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1782480912.944059:0:6609:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1782480913 -> 1782480913 00002000:00010000:3.0:1782480912.944061:0:6609:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00002000:00010000:0.0:1782480912.944083:0:8498:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a3e8010, atime: 0x6a3e8010, ctime: 0x6a3e8010, blocks: 0x1 00010000:00010000:0.0:1782480912.944092:0:8498:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf601c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480912.944100:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3311:x1869066388195200:12345-0@lo:2:osp-syn-0-0.0 Request processed in 197us (802us total) trans 4294967321 rc 0/0 00000100:00100000:3.0:1782480912.944108:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1782480912.944140:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388195072 00000100:00100000:3.0:1782480912.944144:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388195072 00000100:00100000:3.0:1782480912.944161:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782480912.944167:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1869066388195072:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1782480912.944178:0:6609:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00010000:00010000:3.0:1782480912.944191:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.944209:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000006b32b645/0x4776e02a9acf5dde lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff4e expref: 12 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.944219:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782480912.944223:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782480912.944228:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.944259:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000006b32b645/0x4776e02a9acf5dde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff4e expref: 12 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.944274:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000006b32b645/0x4776e02a9acf5dde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff4e expref: 12 pid: 6609 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480912.944286:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe8fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6609:1869066388195328:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480912.944308:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=443s v=(0 0) 00010000:00010000:0.0:1782480912.944312:0:8498:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00000100:00100000:3.0:1782480912.944359:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495900 going to sleep for 11 seconds 00010000:00010000:0.0:1782480912.944466:0:8498:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf601c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.944485:0:8498:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf601c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.944496:0:8498:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf601c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.944504:0:8498:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf601c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.944525:0:8498:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1782480912.944588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:3.0:1782480912.944978:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480912.944986:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf601c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.945004:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782480912.945009:0:5789:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf601c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.945017:0:5789:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf601c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.945034:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf601c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.945041:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e76d4b0c/0x4776e02a9acf601c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 8498 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.945064:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480912.945066:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480912.945068:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480912.945448:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fecc3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3312:x1869066388194944:12345-0@lo:6:osp-syn-1-0.0 Request processed in 2039us (2222us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1782480912.945457:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1782480912.945624:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366188288 00000100:00100000:0.0:1782480912.945630:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366188288 00000100:00100000:0.0:1782480912.945656:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:0.0:1782480912.945695:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:2352:x1869066366188288:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000004:00080000:0.0:1782480912.945773:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7ef6c9500/2, rc 0, transno 4294967321 00000100:00100000:0.0:1782480912.945789:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388195200:0@lo:2:osp-syn-0-0.0 00000004:00080000:1.0:1782480912.946761:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7dfab2a00/2, rc 0, transno 4294967310 00000100:00100000:1.0:1782480912.946771:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfab2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388194944:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1782480912.949476:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480912.949550:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe8fe300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6609:1869066388195328:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782480912.949583:0:6609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480912.949617:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366188416 00000100:00100000:3.0:1782480912.949630:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366188416 00010000:00010000:3.0:1782480912.949689:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000006b32b645/0x4776e02a9acf5dde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff4e expref: 14 pid: 6609 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480912.949738:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1782480912.949746:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+14:2350:x1869066366188416:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480912.949763:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480912.949768:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000006b32b645/0x4776e02a9acf5dde lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff4e expref: 14 pid: 6609 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.949791:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000006b32b645/0x4776e02a9acf5dde lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff4e expref: 14 pid: 6609 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.949817:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006b32b645/0x4776e02a9acf5dde lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff4e expref: 14 pid: 6609 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.949839:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782480912.949843:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1782480912.949849:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.949858:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.949893:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782480912.949942:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+13:2350:x1869066366188416:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 196us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480912.949949:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00010000:00010000:0.0:1782480912.950211:0:6609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.950227:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.950237:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.950245:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.950268:0:6609:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782480912.950770:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480912.950778:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.950795:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782480912.950799:0:5790:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.950809:0:5790:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.950823:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.950830:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095bc5c12/0x4776e02a9acf6023 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.950851:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480912.950853:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480912.950855:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480912.954378:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5af480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+8:3310:x1869066388195072:12345-0@lo:6:osp-syn-0-0.0 Request processed in 10200us (10407us total) trans 4294967322 rc 0/0 00000100:00100000:0.0:1782480912.954392:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1782480912.954501:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7ef6caa00/2, rc 0, transno 4294967322 00000100:00100000:1.0:1782480912.954507:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6caa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388195072:0@lo:6:osp-syn-0-0.0 00000001:00080000:3.0:1782480912.980298:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967316 is committed 00000001:00080000:3.0:1782480912.980421:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967319 is committed 00000001:00080000:3.0:1782480912.980431:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967317 is committed 00000001:00080000:3.0:1782480912.980437:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967321 is committed 00000001:00080000:3.0:1782480912.980441:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967320 is committed 00000100:00100000:2.0:1782480912.980767:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2352:x1869066366188288:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 35066us (36172us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480912.980788:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:1.0:1782480912.983947:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.984128:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366188672 00000100:00100000:0.0:1782480912.984138:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366188672 00000100:00100000:0.0:1782480912.984199:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 228 00000100:00100000:0.0:1782480912.984210:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:11577:x1869066366188672:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782480912.984268:0:5802:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480912.984298:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6007 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffe1 expref: 20 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.984319:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480912.984324:0:5802:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782480912.984353:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.984379:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.984388:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782480912.985146:0:5802:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000ef8797c1 reply state 000000000dcfdbcc transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.985161:0:5802:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782480912.985279:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:11577:x1869066366188672:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1068us (1337us total) trans 4294967508 rc 0/0 00000100:00100000:0.0:1782480912.985288:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 228 00010000:00010000:3.0:1782480912.987532:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.987551:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.987574:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.987581:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782480912.987586:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.987594:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.987610:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:3.0:1782480912.987614:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480912.987619:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480912.987625:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297ba00/0x4776e02a9acf602a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.988428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.988502:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366188800 00000100:00100000:0.0:1782480912.988512:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366188800 00000100:00100000:0.0:1782480912.988584:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:0.0:1782480912.988594:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366188800:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1782480912.988849:0:6607:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1782480912.988853:0:6607:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb mtime from disk: 1782480913 -> 1782480912 00002000:00010000:0.0:1782480912.988855:0:6607:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb atime from disk: 0 -> 1782480912 00002000:00010000:0.0:1782480912.988857:0:6607:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb ctime from disk: 1782480913 -> 1782480912 00002000:00010000:0.0:1782480912.988859:0:6607:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1782480912.988912:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2350:x1869066366188800:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 320us (490us total) trans 4294967323 rc 0/0 00000100:00100000:0.0:1782480912.988919:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:0.0:1782480912.991377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480912.991467:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366189056 00000100:00100000:1.0:1782480912.991476:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366189056 00000100:00100000:1.0:1782480912.991534:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 229 00000100:00100000:1.0:1782480912.991544:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:11577:x1869066366189056:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1782480912.991611:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.991628:0:5804:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffd3 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.991637:0:5804:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.991713:0:5804:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffd3 expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.991727:0:5804:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffd3 expref: 20 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.991742:0:5804:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388195456:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480912.991831:0:5804:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6478000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480912.995277:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.995371:0:12358:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366189184 00000100:00100000:0.0:1782480912.995395:0:12358:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366189184 00010000:00010000:0.0:1782480912.995438:0:12358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffd3 expref: 21 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.995481:0:12358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:0.0:1782480912.995490:0:12358:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:2350:x1869066366189184:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480912.995505:0:12358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480912.995512:0:12358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffd3 expref: 21 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.995524:0:12358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffd3 expref: 21 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.995557:0:12358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480912.995563:0:12358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.995571:0:12358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.995579:0:12358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.995597:0:12358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480912.995688:0:12358:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fe300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:2350:x1869066366189184:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 198us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480912.995695:0:12358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00010000:00010000:1.0:1782480912.996441:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b200/0x4776e02a9acf5feb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffd3 expref: 20 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.996465:0:5804:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5804:1869066388195456:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480912.996490:0:5804:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.996512:0:5804:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.996518:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.996557:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.996564:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.996571:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.996577:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480912.996581:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.996588:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.996598:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:1.0:1782480912.996601:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1782480912.996604:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480912.996610:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf6031 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480912.996883:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:11577:x1869066366189056:12345-192.168.201.58@tcp:55:lhsmtool_posix.0 Request processed in 5339us (5514us total) trans 0 rc -22/-22 00000100:00100000:1.0:1782480912.996899:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 229 00000100:00100000:3.0:1782480912.999479:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480912.999647:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366189312 00000100:00100000:0.0:1782480912.999698:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366189312 00000100:00100000:0.0:1782480912.999762:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:0.0:1782480912.999773:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c528ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2351:x1869066366189312:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1782480912.999830:0:6609:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.999851:0:6609:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.999860:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782480912.999865:0:6609:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480912.999869:0:6609:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 4/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.999904:0:6609:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 8 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480912.999920:0:6609:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 8 pid: 6608 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480912.999936:0:6609:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6609:1869066388195584:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782480913.000016:0:6609:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ca531d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480913.003071:0:6609:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6609:1869066388195584:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782480913.003104:0:6609:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 3/1,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480913.003570:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480913.003760:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366189440 00000100:00100000:0.0:1782480913.003801:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366189440 00010000:00010000:0.0:1782480913.003860:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 9 pid: 6608 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480913.003893:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:0.0:1782480913.003904:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+9:2351:x1869066366189440:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480913.003920:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480913.003944:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 9 pid: 6608 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.003957:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 9 pid: 6608 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.003978:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d1f3deb2/0x4776e02a9acf6015 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffef expref: 9 pid: 6608 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.003995:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480913.004000:0:5787:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1782480913.004006:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.004015:0:5787:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 4/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1782480913.004132:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1782480913.004210:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480913.004270:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2351:x1869066366189440:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 367us (701us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480913.004288:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00010000:00010000:1.0:1782480913.006135:0:6609:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.006152:0:6609:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.006268:0:6609:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 3/1,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.006278:0:6609:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.006286:0:6609:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.006293:0:6609:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297ba00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480913.006297:0:6609:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.006306:0:6609:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.006324:0:6609:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.006331:0:6609:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000267d8eb2/0x4776e02a9acf6038 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6609 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480913.006502:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c528ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2351:x1869066366189312:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 6726us (7028us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480913.006512:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 70 00000100:00100000:3.0:1782480913.009381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480913.009464:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366189696 00000100:00100000:2.0:1782480913.009475:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366189696 00000100:00100000:2.0:1782480913.009566:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 230 00000100:00100000:2.0:1782480913.009577:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:11577:x1869066366189696:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1782480913.009694:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf603f lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.009712:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf603f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.009741:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf603f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.009970:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.009981:0:5803:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5ff9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffda expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.009989:0:5803:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.010022:0:5803:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5ff9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffda expref: 20 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.010035:0:5803:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5ff9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffda expref: 20 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480913.010048:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388195712:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782480913.010129:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c535ec00 going to sleep for 11 seconds 00000100:00080000:0.0:1782480913.010256:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480913.013083:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388195712:192.168.201.58@tcp:104: 00010000:00010000:2.0:1782480913.013116:0:5803:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480913.014159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480913.014803:0:12358:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366189824 00000100:00100000:0.0:1782480913.014815:0:12358:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366189824 00010000:00010000:0.0:1782480913.014861:0:12358:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5ff9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffda expref: 21 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480913.014904:0:12358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:0.0:1782480913.014913:0:12358:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:2351:x1869066366189824:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480913.014931:0:12358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480913.014938:0:12358:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5ff9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffda expref: 21 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.014950:0:12358:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5ff9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffda expref: 21 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.014971:0:12358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b800/0x4776e02a9acf5ff9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffda expref: 21 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.014991:0:12358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480913.014995:0:12358:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.015003:0:12358:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.015010:0:12358:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.015046:0:12358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1782480913.015203:0:5803:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480913.015211:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782480913.015404:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:3.0:1782480913.015577:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:3.0:1782480913.015617:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:3.0:1782480913.015734:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1869066388195840:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782480913.015798:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480913.015829:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c5018240 going to sleep for 11 seconds 00000100:00100000:1.0:1782480913.015950:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388195840 00000100:00100000:1.0:1782480913.015956:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388195840 00000100:00100000:1.0:1782480913.015996:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782480913.016002:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5803:x1869066388195840:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782480913.016082:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5803:x1869066388195840:12345-0@lo:1000:mdt00_001.0 Request processed in 79us (283us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480913.016088:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782480913.016312:0:12358:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5de300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:2351:x1869066366189824:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1398us (2157us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480913.016321:0:12358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:3.0:1782480913.017014:0:5803:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:3.0:1782480913.017020:0:5803:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:3.0:1782480913.017041:0:5803:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7ef6c9500, transno 4294967321 00000100:00100000:3.0:1782480913.017072:0:5803:0:(client.c:3155:ptlrpc_free_committed()) @@@ stopping search req@ffff91d7ef6caa00 x1869066388195072/t4294967322(4294967322) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1782480928 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480913.017085:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1869066388195840:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1782480913.017565:0:5803:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:3.0:1782480913.017843:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1869066388195968:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782480913.017894:0:5803:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480913.017981:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495600 going to sleep for 11 seconds 00000100:00100000:1.0:1782480913.019023:0:5808:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388195968 00000100:00100000:1.0:1782480913.019034:0:5808:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388195968 00000100:00100000:1.0:1782480913.019215:0:5808:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782480913.019226:0:5808:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5803:x1869066388195968:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782480913.019514:0:5808:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5803:x1869066388195968:12345-0@lo:1000:mdt00_001.0 Request processed in 288us (1617us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1782480913.019522:0:5808:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480913.019801:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5dfb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5803:1869066388195968:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1782480913.019842:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.019852:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.019858:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.019864:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480913.019869:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.019876:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.019891:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c32f3f00) 00010000:00010000:0.0:1782480913.019894:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480913.019899:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.019904:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf6046 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.020316:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.020325:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.020348:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.020353:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ec00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782480913.020356:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.020362:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.020372:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480913.020374:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480913.020382:0:5803:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5f90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffbe expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.020393:0:5803:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5f90 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffbe expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.020402:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5f90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffbe expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480913.020437:0:5803:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5f90 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffbe expref: 23 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480913.020452:0:5803:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388196096:192.168.201.58@tcp:105: 00000100:00100000:0.0:1782480913.020703:0:5803:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ca531d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480913.024493:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480913.024571:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366189952 00000100:00100000:2.0:1782480913.024581:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366189952 00000100:00100000:2.0:1782480913.024642:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:2.0:1782480913.024652:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11576:x1869066366189952:12345-192.168.201.58@tcp:49:lfs.0 00000100:00100000:1.0:1782480913.025420:0:5803:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c9500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5803:1869066388196096:192.168.201.58@tcp:105: 00010000:00010000:1.0:1782480913.025449:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025460:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf5f89 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025505:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf604d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025518:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf604d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025540:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf604d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025552:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf604d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025558:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf604d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025565:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf604d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025570:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55f600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480913.025574:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf604d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025580:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf604d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025591:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:1.0:1782480913.025594:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480913.025597:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf604d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025601:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf604d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025618:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf603f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025633:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf603f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025639:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf603f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025643:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2dc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480913.025647:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf603f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025652:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf603f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025674:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:1.0:1782480913.025677:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782480913.025680:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf603f lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.025685:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2dc00/0x4776e02a9acf603f lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480913.025961:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11576:x1869066366189952:12345-192.168.201.58@tcp:49:lfs.0 Request processed in 1307us (1474us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480913.025971:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 61 00000100:00100000:0.0:1782480913.029279:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000040:00080000:0.0:1782480913.029464:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480913.029470:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480913.030005:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1782480913.030017:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1782480913.030268:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366190208 00000100:00100000:3.0:1782480913.030278:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366190208 00000100:00100000:3.0:1782480913.030335:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 231 00000100:00100000:3.0:1782480913.030345:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11576:x1869066366190208:12345-192.168.201.58@tcp:58:lfs.0 00000040:00080000:3.0:1782480913.030746:0:6840:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:3.0:1782480913.030847:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+24:11576:x1869066366190208:12345-192.168.201.58@tcp:58:lfs.0 Request processed in 502us (1577us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480913.030855:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 231 00000100:00100000:1.0:1782480913.031480:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5df800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:11577:x1869066366189696:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 21902us (22105us total) trans 4294967513 rc 0/0 00000100:00100000:1.0:1782480913.031490:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 230 00000020:00080000:1.0:1782480913.031495:0:5803:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:3.0:1782480913.038995:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480913.039329:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366190464 00000100:00100000:2.0:1782480913.039340:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366190464 00000100:00100000:2.0:1782480913.039405:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 62 00000100:00100000:2.0:1782480913.039415:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c9b67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+23:11577:x1869066366190464:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1782480913.040386:0:5806:0:(mdd_object.c:4010:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1782480913.040494:0:5806:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:2.0:1782480913.040555:0:5806:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040572:0:5806:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040585:0:5806:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040594:0:5806:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040600:0:5806:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040606:0:5806:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040643:0:5806:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1782480913.040764:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c9b67050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+25:11577:x1869066366190464:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1347us (1776us total) trans 4294967515 rc 0/0 00000100:00100000:2.0:1782480913.040797:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 62 00000020:00080000:2.0:1782480913.040802:0:5806:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782480913.040858:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480913.040863:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040870:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782480913.040874:0:8324:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040881:0:8324:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040893:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff91d7c610ba00) 00010000:00010000:2.0:1782480913.040896:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782480913.040900:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040906:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d200/0x4776e02a9acf6054 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5806 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480913.040921:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480913.040923:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480913.040925:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480913.081858:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480913.081967:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366190592 00000100:00100000:1.0:1782480913.081979:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366190592 00000100:00100000:1.0:1782480913.082060:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 232 00000100:00100000:1.0:1782480913.082070:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+25:11579:x1869066366190592:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782480913.082096:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480913.082115:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf605b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fff6 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082176:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf6062 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082190:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf6062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082201:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf6062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082214:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6069 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082221:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082227:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082537:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082549:0:5802:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb7 expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082557:0:5802:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082598:0:5802:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb7 expref: 26 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.082612:0:5802:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb7 expref: 26 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480913.082626:0:5802:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388196224:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782480913.082762:0:5802:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6478000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480913.086591:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480913.086713:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366190848 00000100:00100000:3.0:1782480913.086723:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366190848 00000100:00100000:3.0:1782480913.086791:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:3.0:1782480913.086817:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:5566:x1869066366190848:12345-192.168.201.58@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1782480913.087052:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:5566:x1869066366190848:12345-192.168.201.58@tcp:35:ldlm_bl.0 Request processed in 237us (470us total) trans 4294967516 rc 0/0 00000100:00100000:3.0:1782480913.087059:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 63 00000100:00100000:1.0:1782480913.088135:0:5802:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5802:1869066388196224:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782480913.088205:0:5802:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480913.090202:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480913.090362:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366190976 00000100:00100000:3.0:1782480913.090371:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366190976 00010000:00010000:3.0:1782480913.090412:0:5787:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb7 expref: 28 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480913.090452:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:3.0:1782480913.090460:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:2350:x1869066366190976:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782480913.090474:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782480913.090481:0:5787:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb7 expref: 28 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480913.090492:0:5787:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb7 expref: 28 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480913.090514:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fe00/0x4776e02a9acf5f7b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffb7 expref: 28 pid: 5804 timeout: 543 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480913.090541:0:5787:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480913.090546:0:5787:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480913.090555:0:5787:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480913.090582:0:5787:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480913.090613:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782480913.090921:0:5802:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.090929:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480913.090975:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1782480913.090980:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782480913.091001:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091014:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091025:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf6062 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091043:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf6062 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091048:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf6062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091054:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ec00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480913.091058:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf6062 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091065:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf6062 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091074:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:1.0:1782480913.091077:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480913.091080:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf6062 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091087:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf6062 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091097:0:5802:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6069 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091102:0:5802:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6069 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091107:0:5802:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091112:0:5802:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480913.091121:0:5802:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6069 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091127:0:5802:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6069 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091135:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff91d7c8d19700) 00010000:00010000:1.0:1782480913.091138:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782480913.091140:0:5802:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6069 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091146:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6069 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091184:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf605b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fff6 expref: 28 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091197:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fff6 expref: 27 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480913.091218:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:1.0:1782480913.091221:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480913.091223:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55fc00, rc 0) 00000100:00100000:1.0:1782480913.091270:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:11579:x1869066366190592:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 9202us (9422us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480913.091277:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 232 00000100:00100000:3.0:1782480913.092199:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+26:2350:x1869066366190976:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1736us (2001us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480913.092206:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00010000:00010000:0.0:1782480913.376343:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782480913.779471:0:12396:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480913.779481:0:12396:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480913.779534:0:12396:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1782480913.779541:0:12396:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:0.0:1782480914.078993:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480914.079006:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480914.079053:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1782480914.079063:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480914.079236:0:11563:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388196352:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782480914.079392:0:11563:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d802166d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782480914.086581:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480914.086689:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366191104 00000100:00100000:1.0:1782480914.086700:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366191104 00000100:00100000:1.0:1782480914.086788:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 233 00000100:00100000:1.0:1782480914.086801:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:11591:x1869066366191104:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1782480914.086860:0:5804:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1782480914.086981:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:11591:x1869066366191104:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 183us (410us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480914.086989:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 233 00000100:00100000:3.0:1782480914.093709:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480914.093860:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366191360 00000100:00100000:1.0:1782480914.093871:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366191360 00000100:00100000:1.0:1782480914.093952:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 234 00000100:00100000:1.0:1782480914.093963:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:11591:x1869066366191360:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782480914.093983:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480914.094319:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6077 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d99fffd expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.094437:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf607e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.094453:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf607e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.094468:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf607e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480914.094480:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782480914.094627:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf6077 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fffd expref: 30 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.094647:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf607e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fffd expref: 29 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.094732:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:1.0:1782480914.094735:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1782480914.094738:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55ec00, rc 0) 00000100:00100000:1.0:1782480914.094813:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:11591:x1869066366191360:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 851us (1156us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1782480914.094821:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 234 00000100:00100000:0.0:1782480914.098053:0:11563:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef6c8a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11563:1869066388196352:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1782480914.106398:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480914.106453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480914.106579:0:12358:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366191744 00000100:00100000:0.0:1782480914.106590:0:12358:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366191744 00000100:00100000:0.0:1782480914.106694:0:12358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1782480914.106706:0:12358:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:2351:x1869066366191744:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782480914.106725:0:12358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480914.106753:0:12358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55ec00/0x4776e02a9acf607e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fffd expref: 28 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480914.106782:0:12358:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:0.0:1782480914.106787:0:12358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480914.106859:0:12358:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10f1c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:2351:x1869066366191744:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 155us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480914.106867:0:12358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1782480914.107339:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366191616 00000100:00100000:1.0:1782480914.107344:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366191616 00000100:00100000:1.0:1782480914.107386:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 235 00000100:00100000:1.0:1782480914.107395:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+27:11591:x1869066366191616:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1782480914.107469:0:5804:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf608c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.107483:0:5804:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf608c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.107493:0:5804:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf608c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.107731:0:5804:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf608c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.107740:0:5804:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf608c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.107746:0:5804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf608c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.107778:0:5804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480914.107785:0:5804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf608c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.107794:0:5804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf608c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.107805:0:5804:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:1.0:1782480914.107809:0:5804:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1782480914.107813:0:5804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf608c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480914.107819:0:5804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e600/0x4776e02a9acf608c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5804 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480914.108325:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:11591:x1869066366191616:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 925us (1935us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1782480914.108336:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 235 00000040:00080000:0.0:1782480914.110304:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480914.110315:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480914.110827:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1782480914.110838:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782480914.130618:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480914.131424:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366192000 00000100:00100000:3.0:1782480914.131440:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366192000 00000100:00100000:3.0:1782480914.131519:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 64 00000100:00100000:3.0:1782480914.131531:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+28:11591:x1869066366192000:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782480914.131861:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:11591:x1869066366192000:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 330us (1254us total) trans 4294967519 rc 0/0 00000100:00100000:3.0:1782480914.131870:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 64 00010000:00010000:3.0:1782480914.398946:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480914.847632:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388196480:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480914.847755:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480914.847880:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388196480 00000100:00100000:3.0:1782480914.847890:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388196480 00000100:00100000:3.0:1782480914.847963:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1782480914.847973:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1869066388196480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782480914.848015:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782480914.848261:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480914.856807:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1869066388196480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8817us (9043us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480914.856824:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1782480914.858230:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388196480:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480914.934654:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480914.934733:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480914.934768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480914.934798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480914.934825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480914.934863:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366192256 00000100:00100000:2.0:1782480914.934872:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366192256 00000100:00100000:2.0:1782480914.934919:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366192640 00000100:00100000:2.0:1782480914.934922:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366192640 00000100:00100000:2.0:1782480914.934951:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 181 00000100:00100000:2.0:1782480914.934960:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:2350:x1869066366192256:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480914.935042:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:2350:x1869066366192256:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 82us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480914.935157:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366192512 00000100:00100000:1.0:1782480914.935162:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366192512 00000100:00100000:1.0:1782480914.935189:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366192384 00000100:00100000:1.0:1782480914.935192:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366192384 00000100:00100000:1.0:1782480914.935210:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 89 00000100:00100000:1.0:1782480914.935217:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366192512:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480914.935263:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366192512:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 46us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480914.935270:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 89 00000100:00100000:1.0:1782480914.935286:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:1.0:1782480914.935292:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366192384:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480914.935317:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4aa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366192384:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480914.935323:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:1.0:1782480914.935342:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 182 00000100:00100000:1.0:1782480914.935349:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2350:x1869066366192640:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480914.935371:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2350:x1869066366192640:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 23us (546us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480914.935377:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 182 00000100:00080000:1.0:1782480914.935416:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1782480914.935420:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480914.935826:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366192128 00000100:00100000:3.0:1782480914.935839:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366192128 00000100:00100000:3.0:1782480914.935879:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 307 00000100:00100000:3.0:1782480914.935887:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366192128:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480914.935925:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366192128:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 40us (1156us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480914.935931:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 307 00000100:00100000:2.0:1782480914.936211:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 181 00010000:00010000:2.0:1782480915.426280:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1782480915.658147:0:12447:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1782480915.658158:0:12447:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1782480915.658207:0:12447:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1782480915.658213:0:12447:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1782480915.828469:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480915.828561:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366192896 00000100:00100000:1.0:1782480915.828573:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366192896 00000100:00100000:1.0:1782480915.828695:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 236 00000100:00100000:1.0:1782480915.828706:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+29:11611:x1869066366192896:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782480915.828740:0:6840:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480915.828764:0:6840:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf6093 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0004 expref: -99 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.828901:0:6840:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf609a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.828936:0:6840:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf609a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.828951:0:6840:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf609a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6840 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782480915.828964:0:6840:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1782480915.829098:0:6840:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e200/0x4776e02a9acf6093 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0004 expref: 32 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.829113:0:6840:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf609a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0004 expref: 31 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.829122:0:6840:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:1.0:1782480915.829125:0:6840:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1782480915.829129:0:6840:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55f600, rc 0) 00000100:00100000:1.0:1782480915.829185:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11611:x1869066366192896:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 482us (727us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1782480915.829193:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 236 00000100:00080000:2.0:1782480915.829611:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480915.850527:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480915.850636:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366193024 00000100:00100000:1.0:1782480915.850646:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366193024 00000100:00100000:1.0:1782480915.850745:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 237 00000100:00100000:1.0:1782480915.850756:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11611:x1869066366193024:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:1.0:1782480915.850831:0:5803:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf60a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.850850:0:5803:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf60a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.851023:0:5803:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf60a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.851055:0:5803:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf60a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.851062:0:5803:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf60a8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.851069:0:5803:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf60a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.851075:0:5803:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782480915.851079:0:5803:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf60a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.851086:0:5803:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf60a8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.851099:0:5803:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:1.0:1782480915.851102:0:5803:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782480915.851107:0:5803:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf60a8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.851113:0:5803:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e800/0x4776e02a9acf60a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5803 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480915.851195:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+31:11611:x1869066366193024:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 440us (679us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480915.851203:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 237 00000100:00100000:0.0:1782480915.954775:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480915.955975:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366193152 00000100:00100000:1.0:1782480915.955999:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366193152 00000100:00100000:1.0:1782480915.956185:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00100000:1.0:1782480915.956196:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2352:x1869066366193152:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:1.0:1782480915.956215:0:6608:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480915.956236:0:6608:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf60af lrc: 2/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a000b expref: -99 pid: 6608 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782480915.956264:0:6608:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a3e8010, atime: 0x6a3e8010, ctime: 0x6a3e8010, blocks: 0xb 00010000:00010000:1.0:1782480915.956284:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1782480915.956288:0:6608:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782480915.956298:0:6608:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf60af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a000b expref: 8 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.956318:0:6608:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf60af lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a000b expref: 8 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480915.956331:0:6608:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55e800, rc 0) 00000100:00100000:1.0:1782480915.956396:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2352:x1869066366193152:12345-192.168.201.58@tcp:101:cat.0 Request processed in 201us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480915.956404:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 71 00000100:00080000:0.0:1782480915.957123:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782480915.974084:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480915.974123:0:6612:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366193280 00000100:00100000:3.0:1782480915.974132:0:6612:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366193280 00002000:00100000:3.0:1782480915.974182:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91d7df4c8a80 x1869066366193280/t0(0) o3->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:671/0 lens 488/0 e 0 to 0 dl 1782480926 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480915.974194:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7df4c8a80 with x1869066366193280 ext(0->4095) 00002000:00010000:3.0:1782480915.974201:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7df4c8a80 00000100:00100000:3.0:1782480915.974226:0:6612:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:3.0:1782480915.974236:0:6612:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2351:x1869066366193280:12345-192.168.201.58@tcp:3:cat.0 00000100:00100000:3.0:1782480915.974426:0:6612:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4c8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+8:2351:x1869066366193280:12345-192.168.201.58@tcp:3:cat.0 Request processed in 191us (354us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1782480915.974434:0:6612:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00002000:00100000:3.0:1782480915.974440:0:6612:0:(ofd_dev.c:2709:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x6:0x0] (0->4095) req@ffff91d7df4c8a80 x1869066366193280/t0(0) o3->227f6c69-cfd7-4cc4-bae6-15b91431c78c@192.168.201.58@tcp:671/0 lens 488/4536 e 0 to 0 dl 1782480926 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1782480915.974448:0:6612:0:(ofd_dev.c:2565:ofd_prolong_extent_locks()) Prolong locks for req ffff91d7df4c8a80 with x1869066366193280 ext(0->4095) 00002000:00010000:3.0:1782480915.974451:0:6612:0:(ofd_dev.c:2714:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff91d7df4c8a80 00000001:00080000:2.0:1782480915.989043:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:2.0:1782480915.989229:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00010000:00010000:0.0:1782480916.448142:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480917.409870:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388196608:0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.409952:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480917.410010:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388197120:0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.410040:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480917.410068:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480917.410074:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388196992:0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.410116:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480917.410149:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388196736:0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.410173:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480917.410190:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388197248:0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.410216:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480917.410234:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480917.410240:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388196864:0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.410263:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480917.410293:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388197120 00000100:00100000:2.0:1782480917.410300:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388197120 00000100:00100000:2.0:1782480917.410349:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388196736 00000100:00100000:2.0:1782480917.410352:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388196736 00000100:00100000:2.0:1782480917.410367:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388196864 00000100:00100000:2.0:1782480917.410370:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388196864 00000100:00100000:2.0:1782480917.410388:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1782480917.410397:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388197120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.410453:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc51c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388197120:12345-0@lo:400:kworker.0 Request processed in 57us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480917.410461:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:2.0:1782480917.410480:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1782480917.410486:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388196736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.410517:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc53b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388196736:12345-0@lo:400:kworker.0 Request processed in 31us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480917.410523:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:2.0:1782480917.410535:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1782480917.410542:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388196864:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.412949:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388196864:12345-0@lo:400:kworker.0 Request processed in 2397us (2674us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480917.412965:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1782480917.413058:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc50380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388197120:0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.413101:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388196864:0@lo:400:kworker.0 00000100:00100000:2.0:1782480917.413114:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4aad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388196736:0@lo:400:kworker.0 00000100:00100000:1.0:1782480917.416307:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1782480917.416331:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388197376:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480917.416647:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388196992 00000100:00100000:0.0:1782480917.416656:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388196992 00000100:00100000:0.0:1782480917.416749:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388197248 00000100:00100000:0.0:1782480917.416753:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388197248 00000100:00100000:0.0:1782480917.416783:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782480917.416794:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1869066388196992:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480917.416870:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efc53100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3313:x1869066388196992:12345-0@lo:400:kworker.0 Request processed in 79us (6753us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480917.416877:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1782480917.416894:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1782480917.416900:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388197248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480917.416928:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006ae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388197248:12345-0@lo:400:kworker.0 Request processed in 29us (6712us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480917.416934:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1782480917.416958:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480917.416963:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480917.416981:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480917.417063:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc51f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388196992:0@lo:400:kworker.0 00000100:00100000:3.0:1782480917.418171:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388196608 00000100:00100000:3.0:1782480917.418179:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388196608 00000100:00100000:3.0:1782480917.418327:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1782480917.418345:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388196608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480917.418428:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8051c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388196608:12345-0@lo:400:kworker.0 Request processed in 84us (8476us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480917.418435:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 308 00000100:00100000:3.0:1782480917.418585:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388196608:0@lo:400:kworker.0 00000100:00100000:1.0:1782480917.420912:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480917.420997:0:3310:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:1.0:1782480917.421005:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967310 00000004:00080000:1.0:1782480917.421028:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7dfab2a00, transno 4294967310 00000100:00100000:1.0:1782480917.421069:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efc51880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388197248:0@lo:400:kworker.0 00000100:00100000:3.0:1782480917.421142:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388197376 00000100:00100000:3.0:1782480917.421151:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388197376 00000100:00100000:3.0:1782480917.421212:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782480917.421222:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388197376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1782480917.421263:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480917.421331:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388197376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (4927us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480917.421338:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1782480917.421376:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388197376:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480917.472795:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1782480917.966283:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967508 is committed 00000001:00080000:3.0:1782480917.966524:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:3.0:1782480917.966638:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d7df495900 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:3.0:1782480917.966644:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4fd2d00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d7c62533c0 00000020:00080000:3.0:1782480917.966648:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4fd2400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d7efc46400 00000020:00080000:3.0:1782480917.966707:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:1.0:1782480917.966789:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:1.0:1782480917.967016:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000001:00080000:3.0:1782480918.486784:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967323 is committed 00000001:00080000:3.0:1782480918.486799:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967322 is committed 00000001:00080000:3.0:1782480918.486805:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967324 is committed 00010000:00010000:2.0:1782480918.496931:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480919.522928:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480919.967201:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388197504:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480919.967284:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480919.967434:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388197504 00000100:00100000:0.0:1782480919.967448:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388197504 00000100:00100000:0.0:1782480919.967512:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1782480919.967529:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388197504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480919.967563:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480919.967604:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388197504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480919.967611:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1782480919.967679:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480919.967707:0:3312:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1782480919.967712:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7ef6caa00, transno 4294967322 00000004:00080000:1.0:1782480919.967727:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:1.0:1782480919.967757:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4ab480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388197504:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480920.045232:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480920.045280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480920.045326:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480920.045360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480920.045391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480920.045427:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366193792 00000100:00100000:0.0:1782480920.045439:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366193792 00000100:00100000:0.0:1782480920.045499:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366193664 00000100:00100000:0.0:1782480920.045503:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366193664 00000100:00100000:0.0:1782480920.045527:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:0.0:1782480920.045538:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef6caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2352:x1869066366193792:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480920.045627:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef6caa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2352:x1869066366193792:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 91us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480920.045635:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:0.0:1782480920.045654:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:0.0:1782480920.045701:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ecea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2352:x1869066366193664:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782480920.045730:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ecea1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2352:x1869066366193664:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 31us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480920.045755:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:3.0:1782480920.045865:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366193408 00000100:00100000:3.0:1782480920.045875:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366193408 00000100:00100000:3.0:1782480920.045915:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 309 00000100:00100000:3.0:1782480920.045922:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366193408:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480920.045953:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2352:x1869066366193408:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 31us (625us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480920.045960:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 309 00000100:00080000:1.0:1782480920.046362:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1782480920.046367:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782480920.046825:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366193536 00000100:00100000:2.0:1782480920.046833:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366193536 00000100:00100000:2.0:1782480920.047231:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366193920 00000100:00100000:2.0:1782480920.047237:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366193920 00000100:00100000:2.0:1782480920.047284:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 186 00000100:00100000:2.0:1782480920.047293:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:2352:x1869066366193536:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480920.047367:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe8fe300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:2352:x1869066366193536:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 75us (2147us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480920.047374:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 186 00000100:00100000:2.0:1782480920.047391:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00100000:2.0:1782480920.047398:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366193920:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782480920.047424:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:2352:x1869066366193920:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 27us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480920.047431:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 187 00000100:00080000:1.0:1782480920.047734:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782480920.543786:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1782480921.312870:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1782480921.312880:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782480921.313152:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:0.0:1782480921.313159:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1782480921.568166:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480921.986911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480921.986997:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366194048 00000100:00100000:2.0:1782480921.987025:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366194048 00000100:00100000:2.0:1782480921.987102:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 238 00000100:00100000:2.0:1782480921.987114:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:11264:x1869066366194048:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 00000100:00100000:2.0:1782480921.987245:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:11264:x1869066366194048:12345-192.168.201.58@tcp:60:lhsmtool_posix.0 Request processed in 133us (343us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480921.987253:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 238 00000100:00100000:2.0:1782480922.006025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480922.014868:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366194304 00000100:00100000:3.0:1782480922.014884:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366194304 00000100:00100000:3.0:1782480922.014966:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:3.0:1782480922.014980:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:11264:x1869066366194304:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00080000:1.0:1782480922.015867:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782480922.016360:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:11264:x1869066366194304:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 1375us (10335us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1782480922.016373:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 65 00000100:00100000:3.0:1782480922.274143:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480922.274394:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366194432 00000100:00100000:2.0:1782480922.274405:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366194432 00000100:00100000:2.0:1782480922.274494:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 239 00000100:00100000:2.0:1782480922.274505:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+5:12064:x1869066366194432:12345-192.168.201.58@tcp:101:lsof.0 00010000:00010000:2.0:1782480922.274526:0:5802:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480922.274547:0:5802:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf60b6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0012 expref: -99 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480922.274612:0:5802:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf60bd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480922.274639:0:5802:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf60bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480922.274652:0:5802:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf60bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782480922.274896:0:5802:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782480922.274901:0:5802:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782480922.274986:0:5802:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf60bd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5802 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480922.275013:0:5802:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c400/0x4776e02a9acf60b6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0012 expref: 7 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480922.275040:0:5802:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf60bd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0012 expref: 6 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480922.275259:0:5802:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3300) 00010000:00010000:2.0:1782480922.275264:0:5802:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782480922.275360:0:5802:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2c200, rc 0) 00000100:00080000:1.0:1782480922.275520:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480922.275603:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c12aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:12064:x1869066366194432:12345-192.168.201.58@tcp:101:lsof.0 Request processed in 1098us (1467us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480922.275610:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 239 00000100:00100000:3.0:1782480922.527016:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388197632:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480922.527097:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480922.527252:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388197632 00000100:00100000:0.0:1782480922.527274:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388197632 00000100:00100000:0.0:1782480922.527353:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782480922.527373:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388197632:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782480922.527415:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782480922.527482:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388197632:12345-0@lo:13:osp-pre-1-0.0 Request processed in 120us (385us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480922.527491:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1782480922.527547:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388197632:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1782480922.527873:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480922.528125:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388198144:0@lo:400:kworker.0 00000100:00100000:0.0:1782480922.528163:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480922.528186:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480922.528193:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388198016:0@lo:400:kworker.0 00000100:00100000:0.0:1782480922.528219:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480922.528244:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388198144 00000100:00100000:0.0:1782480922.528248:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388198144 00000100:00100000:0.0:1782480922.528301:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782480922.528309:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388198144:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480922.528351:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388198144:12345-0@lo:400:kworker.0 Request processed in 43us (188us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480922.528386:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1782480922.528423:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388198144:0@lo:400:kworker.0 00000100:00100000:1.0:1782480922.528556:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388197888:0@lo:400:kworker.0 00000100:00100000:1.0:1782480922.528586:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480922.528622:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1782480922.528629:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388197760:0@lo:400:kworker.0 00000100:00100000:1.0:1782480922.528687:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480922.528714:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388198272:0@lo:400:kworker.0 00000100:00100000:1.0:1782480922.528736:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480922.528758:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388197760 00000100:00100000:1.0:1782480922.528761:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388197760 00000100:00100000:1.0:1782480922.528789:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1782480922.528795:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388197760:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480922.528837:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3311:x1869066388197760:12345-0@lo:400:kworker.0 Request processed in 42us (149us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480922.528843:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00080000:1.0:1782480922.528876:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1782480922.528893:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef5ab800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388197760:0@lo:400:kworker.0 00000100:00100000:2.0:1782480922.529409:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388198016 00000100:00100000:2.0:1782480922.529415:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388198016 00000100:00080000:1.0:1782480922.529584:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480922.529637:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1782480922.529647:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388198016:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480922.529734:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388198016:12345-0@lo:400:kworker.0 Request processed in 89us (1513us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480922.529740:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:2.0:1782480922.529755:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388197888 00000100:00100000:2.0:1782480922.529759:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388197888 00000100:00100000:2.0:1782480922.529773:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388198272 00000100:00100000:2.0:1782480922.529775:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388198272 00000100:00100000:2.0:1782480922.529799:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1782480922.529805:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388197888:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480922.529842:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388197888:12345-0@lo:400:kworker.0 Request processed in 37us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480922.529850:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1782480922.529862:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:2.0:1782480922.529879:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388198272:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480922.529910:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388198272:12345-0@lo:400:kworker.0 Request processed in 33us (1173us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480922.529917:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:2.0:1782480922.529933:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480922.529956:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfa7b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388198272:0@lo:400:kworker.0 00000100:00100000:2.0:1782480922.529968:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ff800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388197888:0@lo:400:kworker.0 00000100:00100000:1.0:1782480922.530056:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388198016:0@lo:400:kworker.0 00010000:00010000:2.0:1782480922.590853:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:0.0:1782480923.146313:0:5825:0:(update_trans.c:1341:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000001:00080000:0.0:1782480923.146340:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:1.0:1782480923.146812:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1782480923.146825:0:5836:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1782480923.614891:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480924.641051:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480925.087135:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480925.087160:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388198400:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480925.087238:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480925.087532:0:6610:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388198400 00000100:00100000:0.0:1782480925.087542:0:6610:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388198400 00000100:00100000:0.0:1782480925.087626:0:6610:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1782480925.087636:0:6610:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388198400:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782480925.087694:0:6610:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:2.0:1782480925.087832:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480925.087911:0:6610:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388198400:12345-0@lo:13:osp-pre-0-0.0 Request processed in 275us (672us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480925.087919:0:6610:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1782480925.088003:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388198400:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782480925.163824:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480925.163864:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480925.163894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480925.163917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480925.163943:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480925.163969:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366194944 00000100:00100000:1.0:1782480925.163979:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366194944 00000100:00100000:1.0:1782480925.164040:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366194816 00000100:00100000:1.0:1782480925.164043:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366194816 00000100:00100000:1.0:1782480925.164066:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:1.0:1782480925.164075:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366194944:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480925.164151:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2350:x1869066366194944:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480925.164158:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:1.0:1782480925.164176:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:1.0:1782480925.164182:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366194816:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480925.164222:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2350:x1869066366194816:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 40us (303us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480925.164228:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:1.0:1782480925.164247:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366194688 00000100:00100000:1.0:1782480925.164250:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366194688 00000100:00100000:1.0:1782480925.164271:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366195072 00000100:00100000:1.0:1782480925.164273:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366195072 00000100:00100000:1.0:1782480925.164287:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:1.0:1782480925.164293:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:2350:x1869066366194688:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480925.164320:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:2350:x1869066366194688:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 28us (506us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480925.164326:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 191 00000100:00100000:1.0:1782480925.164336:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 192 00000100:00100000:1.0:1782480925.164341:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2350:x1869066366195072:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782480925.164358:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2350:x1869066366195072:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 18us (415us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480925.164364:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 192 00000100:00100000:3.0:1782480925.164637:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366194560 00000100:00100000:3.0:1782480925.164642:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366194560 00000100:00100000:3.0:1782480925.164696:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 311 00000100:00100000:3.0:1782480925.164702:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366194560:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480925.164734:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366194560:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 33us (839us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480925.164740:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 311 00000100:00080000:2.0:1782480925.164986:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1782480925.164991:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1782480925.165002:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1782480925.672306:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480926.694781:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1782480926.701942:0:12653:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 09:35:24 (1782480924) 00000100:00100000:0.0:1782480927.648359:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388198528:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480927.648467:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480927.648517:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388198784:0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.648551:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388199040:0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.648602:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480927.648610:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480927.648648:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1782480927.648691:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388198656:0@lo:400:kworker.0 00000100:00100000:3.0:1782480927.648712:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388199296:0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.648731:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480927.648779:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480927.648786:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388199168:0@lo:400:kworker.0 00000100:00100000:3.0:1782480927.648825:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480927.648837:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388198912:0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.648848:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480927.648889:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480927.648906:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388198528 00000100:00100000:0.0:1782480927.648915:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388198528 00000100:00100000:3.0:1782480927.648950:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388198784 00000100:00100000:3.0:1782480927.648959:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388198784 00000100:00100000:0.0:1782480927.648981:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782480927.648996:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388198528:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782480927.649022:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388199168 00000100:00100000:3.0:1782480927.649028:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388199168 00002000:00000024:0.0:1782480927.649049:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782480927.649058:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388198912 00000100:00100000:3.0:1782480927.649065:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388198912 00000100:00100000:3.0:1782480927.649098:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 193 00000100:00100000:3.0:1782480927.649110:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388198784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.649120:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388198528:12345-0@lo:13:osp-pre-1-0.0 Request processed in 126us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.649132:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1782480927.649170:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388199040 00000100:00100000:0.0:1782480927.649175:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388199040 00000100:00100000:3.0:1782480927.649186:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388198784:12345-0@lo:400:kworker.0 Request processed in 78us (578us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480927.649199:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 193 00000100:00100000:0.0:1782480927.649218:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388199296 00000100:00100000:0.0:1782480927.649222:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388199296 00000100:00100000:3.0:1782480927.649230:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1782480927.649242:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388199168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.649253:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1782480927.649265:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388199040:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480927.649309:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1869066388199168:12345-0@lo:400:kworker.0 Request processed in 68us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.649319:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388199040:12345-0@lo:400:kworker.0 Request processed in 57us (717us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.649341:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1782480927.649348:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:0.0:1782480927.649365:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1782480927.649380:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388199296:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480927.649385:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 195 00000100:00100000:3.0:1782480927.649399:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388198912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.649422:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388199296:12345-0@lo:400:kworker.0 Request processed in 47us (646us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.649430:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1782480927.649456:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388198912:12345-0@lo:400:kworker.0 Request processed in 56us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480927.649456:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388198656 00000100:00100000:0.0:1782480927.649464:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388198656 00000100:00100000:3.0:1782480927.649470:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 195 00000100:00100000:0.0:1782480927.649506:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 312 00000100:00100000:0.0:1782480927.649535:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388198656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480927.649562:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388198912:0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.649587:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388198656:12345-0@lo:400:kworker.0 Request processed in 70us (853us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480927.649588:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388198784:0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.649610:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 312 00000100:00100000:3.0:1782480927.649621:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388199296:0@lo:400:kworker.0 00000100:00080000:0.0:1782480927.649683:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480927.649691:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480927.649702:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782480927.649756:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388198656:0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.649774:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1869066388199168:0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.649786:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388199040:0@lo:400:kworker.0 00000100:00100000:0.0:1782480927.649802:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388198528:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1782480927.712029:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480928.735343:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480929.762967:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480930.207241:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480930.207268:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388199424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782480930.207349:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480930.207651:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388199424 00000100:00100000:1.0:1782480930.207693:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388199424 00000100:00100000:1.0:1782480930.207770:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1782480930.207780:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388199424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782480930.207827:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480930.207872:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388199424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480930.207880:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:0.0:1782480930.208707:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480930.208766:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388199424:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782480930.283576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480930.283622:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480930.283691:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480930.283715:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480930.283759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480930.283789:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366195200 00000100:00100000:3.0:1782480930.283799:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366195200 00000100:00100000:3.0:1782480930.283852:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 313 00000100:00100000:3.0:1782480930.283863:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366195200:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480930.283942:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2353:x1869066366195200:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 80us (249us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480930.283949:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 313 00000100:00100000:3.0:1782480930.283984:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366195584 00000100:00100000:3.0:1782480930.283987:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366195584 00000100:00100000:3.0:1782480930.284032:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366195456 00000100:00100000:3.0:1782480930.284036:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366195456 00000100:00100000:3.0:1782480930.284058:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:3.0:1782480930.284065:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366195584:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480930.284094:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2353:x1869066366195584:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 30us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480930.284100:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:3.0:1782480930.284111:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:3.0:1782480930.284116:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2353:x1869066366195456:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480930.284137:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2353:x1869066366195456:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 21us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480930.284143:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:3.0:1782480930.284160:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366195328 00000100:00100000:3.0:1782480930.284163:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366195328 00000100:00100000:3.0:1782480930.284183:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366195712 00000100:00100000:3.0:1782480930.284186:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366195712 00000100:00100000:3.0:1782480930.284200:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 196 00000100:00100000:3.0:1782480930.284206:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:2353:x1869066366195328:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480930.284231:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:2353:x1869066366195328:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 26us (666us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480930.284238:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 196 00000100:00100000:3.0:1782480930.284248:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00100000:3.0:1782480930.284253:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2353:x1869066366195712:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782480930.284272:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfab3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2353:x1869066366195712:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 18us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480930.284287:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 197 00000100:00080000:0.0:1782480930.284536:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782480930.284541:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782480930.284543:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1782480930.782855:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782480931.550955:0:11563:0:(llog.c:800:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1782480931.550967:0:11563:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782480931.551403:0:11563:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:1.0:1782480931.551416:0:11563:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1782480931.665042:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480931.665505:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366195968 00000100:00100000:3.0:1782480931.665516:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366195968 00000100:00100000:3.0:1782480931.665589:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:3.0:1782480931.665600:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+18:12285:x1869066366195968:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:3.0:1782480931.666356:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4ab480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:12285:x1869066366195968:12345-192.168.201.58@tcp:35:umount.0 Request processed in 754us (1321us total) trans 4294967522 rc 0/0 00000100:00100000:3.0:1782480931.666365:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 66 00000100:00100000:3.0:1782480931.672419:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480931.675166:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366196224 00000100:00100000:0.0:1782480931.675196:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366196224 00000100:00100000:0.0:1782480931.675319:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:0.0:1782480931.675332:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+19:12285:x1869066366196224:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:0.0:1782480931.676986:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:12285:x1869066366196224:12345-192.168.201.58@tcp:35:umount.0 Request processed in 1647us (4573us total) trans 4294967523 rc 0/0 00000100:00100000:0.0:1782480931.676996:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 67 00000100:00100000:2.0:1782480931.681847:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480931.681980:0:5805:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366196480 00000100:00100000:3.0:1782480931.681990:0:5805:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366196480 00000100:00100000:3.0:1782480931.682525:0:5805:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:3.0:1782480931.682538:0:5805:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d160b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+20:12285:x1869066366196480:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:3.0:1782480931.683172:0:5805:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d160b850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:12285:x1869066366196480:12345-192.168.201.58@tcp:35:umount.0 Request processed in 635us (1331us total) trans 4294967524 rc 0/0 00000100:00100000:3.0:1782480931.683181:0:5805:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 68 00000100:00100000:2.0:1782480931.697106:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480931.697160:0:5806:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366196736 00000100:00100000:0.0:1782480931.697172:0:5806:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366196736 00000100:00100000:0.0:1782480931.697239:0:5806:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:0.0:1782480931.697250:0:5806:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:12285:x1869066366196736:12345-192.168.201.58@tcp:35:umount.0 00000100:00100000:1.0:1782480931.698606:0:5806:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4aad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:12285:x1869066366196736:12345-192.168.201.58@tcp:35:umount.0 Request processed in 1347us (1500us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1782480931.698618:0:5806:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 69 00000100:00100000:1.0:1782480931.730052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480931.730157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480931.730355:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366196864 00000100:00100000:0.0:1782480931.730365:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366196864 00000100:00100000:0.0:1782480931.730737:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366196992 00000100:00100000:0.0:1782480931.730742:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366196992 00000100:00100000:1.0:1782480931.732615:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1782480931.732640:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a65011-408e-4936-8eb0-c95e426cdd7c+14:2350:x1869066366196864:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480931.732689:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480931.732716:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167be00/0x4776e02a9acf50d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb9d expref: 14 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480931.732737:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480931.732813:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a65011-408e-4936-8eb0-c95e426cdd7c+13:2350:x1869066366196864:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 185us (2771us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480931.732821:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:1.0:1782480931.732847:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:1.0:1782480931.732854:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:2350:x1869066366196992:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480931.732862:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480931.732872:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf5349 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc68 expref: 12 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480931.732881:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480931.732899:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:2350:x1869066366196992:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 46us (2742us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480931.732931:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:2.0:1782480931.740574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782480931.740725:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366197120 00000100:00100000:3.0:1782480931.740735:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366197120 00000100:00100000:3.0:1782480931.740799:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 72 00000100:00100000:3.0:1782480931.740808:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2349:x1869066366197120:12345-192.168.201.58@tcp:9:umount.0 00000020:00000080:3.0:1782480931.740842:0:6609:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf540d 00000100:00080000:3.0:1782480931.740852:0:6609:0:(import.c:65:import_set_state_nolock()) ffff91d7c9866000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1782480931.740903:0:6609:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:3.0:1782480931.741189:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4ab480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:227f6c69-cfd7-4cc4-bae6-15b91431c78c+2:2349:x1869066366197120:12345-192.168.201.58@tcp:9:umount.0 Request processed in 381us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480931.741212:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 72 00010000:00010000:2.0:1782480931.741534:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480931.759484:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480931.759699:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366197248 00000100:00100000:1.0:1782480931.759711:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366197248 00000100:00100000:1.0:1782480931.760773:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1782480931.760789:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:2350:x1869066366197248:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782480931.760808:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480931.760831:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167b000/0x4776e02a9acf509b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fb65 expref: 11 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480931.760852:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480931.760937:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2350:x1869066366197248:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 154us (1464us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480931.760945:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1782480931.764991:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480931.765304:0:8498:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366197632 00000100:00100000:0.0:1782480931.765315:0:8498:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366197632 00000100:00100000:0.0:1782480931.765475:0:8498:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 73 00000100:00100000:0.0:1782480931.765486:0:8498:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+7:2349:x1869066366197632:12345-192.168.201.58@tcp:9:umount.0 00000020:00000080:0.0:1782480931.765521:0:8498:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf566e 00000020:00010000:0.0:1782480931.765529:0:8498:0:(genops.c:1942:obd_stale_export_put()) Put export ffff91d7d1fcc000: total 0 00000100:00080000:0.0:1782480931.765534:0:8498:0:(import.c:65:import_set_state_nolock()) ffff91d7efc98800 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782480931.765611:0:8498:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:0.0:1782480931.765949:0:8498:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+5:2349:x1869066366197632:12345-192.168.201.58@tcp:9:umount.0 Request processed in 464us (967us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480931.765957:0:8498:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 73 00000020:00010000:3.0:1782480931.766020:0:5790:0:(genops.c:1928:obd_stale_export_get()) Get export ffff91d7d1fcc000: total 0 00010000:00010000:3.0:1782480931.766064:0:5790:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91d7d1fcc000, canceled 0 locks, left on hash table 2. 00010000:00010000:3.0:1782480931.766121:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ee04902a/0x4776e02a9acf5a11 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe3d expref: 4 pid: 6607 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.766168:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf60af lrc: 0/0,0 mode: --/PR res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a000b expref: 3 pid: 6608 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.766184:0:5790:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91d7d1fcc000, canceled 2 locks, left on hash table 0. 00010000:00010000:3.0:1782480931.766206:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480931.766209:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480931.766211:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480931.793534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480931.793795:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366198656 00000100:00100000:0.0:1782480931.793805:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366198656 00000100:00100000:0.0:1782480931.793870:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 240 00000100:00100000:0.0:1782480931.793880:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+22:2349:x1869066366198656:12345-192.168.201.58@tcp:39:umount.0 00000020:00000080:0.0:1782480931.793916:0:6840:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf50a9 00000020:00010000:0.0:1782480931.793937:0:6840:0:(genops.c:1942:obd_stale_export_put()) Put export ffff91d7ef6c2000: total 0 00000100:00080000:0.0:1782480931.793942:0:6840:0:(import.c:65:import_set_state_nolock()) ffff91d7ed06d000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1782480931.793979:0:6840:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1782480931.794763:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:227f6c69-cfd7-4cc4-bae6-15b91431c78c+21:2349:x1869066366198656:12345-192.168.201.58@tcp:39:umount.0 Request processed in 869us (1225us total) trans 4294967526 rc 0/0 00000100:00100000:0.0:1782480931.794773:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 240 00000020:00010000:3.0:1782480931.795786:0:8324:0:(genops.c:1928:obd_stale_export_get()) Get export ffff91d7ef6c2000: total 0 00010000:00010000:3.0:1782480931.795833:0:8324:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91d7ef6c2000, canceled 0 locks, left on hash table 13. 00010000:00010000:3.0:1782480931.795868:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3300) 00010000:00010000:3.0:1782480931.795872:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480931.795885:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf5a73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe59 expref: 20 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.795906:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c8d19d00) 00010000:00010000:3.0:1782480931.795909:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782480931.795913:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55e400/0x4776e02a9acf538f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc7d expref: 19 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.795952:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480931.795954:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480931.795958:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d000/0x4776e02a9acf59d2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe28 expref: 18 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.795971:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480931.795973:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1782480931.795977:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55fc00/0x4776e02a9acf6070 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fff6 expref: 17 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.795988:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480931.795990:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782480931.795994:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f600/0x4776e02a9acf609a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0004 expref: 16 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.796004:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d7c32f3a00) 00010000:00010000:3.0:1782480931.796007:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480931.796011:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf5373 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc76 expref: 15 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.796026:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:3.0:1782480931.796029:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1782480931.796032:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f000/0x4776e02a9acf59fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe36 expref: 14 pid: 6840 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.796043:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:3.0:1782480931.796046:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1782480931.796112:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f200/0x4776e02a9acf53e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc92 expref: 13 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480931.796192:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff91d7c32f3e00) 00010000:00010000:3.0:1782480931.797354:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782480931.797365:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a000/0x4776e02a9acf5f90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ffbe expref: 12 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.798935:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff91d7c8d19400) 00010000:00010000:0.0:1782480931.798960:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782480931.798972:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d600/0x4776e02a9acf56d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fd64 expref: 11 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.798999:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480931.799001:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782480931.799005:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7ef55f800/0x4776e02a9acf5a8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fe60 expref: 10 pid: 5803 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.799017:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff91d7c8d19c00) 00010000:00010000:0.0:1782480931.799019:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1782480931.799022:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf5d6e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99ff32 expref: 9 pid: 5804 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.799036:0:8324:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff91d7c8d19b00) 00010000:00010000:0.0:1782480931.799038:0:8324:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782480931.799041:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b400/0x4776e02a9acf58f2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fdf0 expref: 8 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480931.799477:0:8324:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91d7ef6c2000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1782480931.799515:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480931.799517:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480931.799520:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480931.808015:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480932.772854:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388199808:0@lo:400:kworker.0 00000100:00100000:0.0:1782480932.772929:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480932.773018:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388199808 00000100:00100000:0.0:1782480932.773027:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388199808 00000100:00100000:0.0:1782480932.773084:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:0.0:1782480932.773095:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388199808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480932.773170:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388199808:12345-0@lo:400:kworker.0 Request processed in 77us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480932.773192:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:0.0:1782480932.773216:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782480932.773246:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4f9ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388199808:0@lo:400:kworker.0 00000100:00100000:0.0:1782480932.773289:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388199936:0@lo:400:kworker.0 00000100:00100000:0.0:1782480932.773328:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480932.773360:0:6609:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388199936 00000100:00100000:0.0:1782480932.773365:0:6609:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388199936 00000100:00100000:0.0:1782480932.773408:0:6609:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1782480932.773416:0:6609:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388199936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480932.773484:0:6609:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388199936:12345-0@lo:400:kworker.0 Request processed in 69us (154us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480932.773490:0:6609:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00080000:0.0:1782480932.773506:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782480932.773522:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388199936:0@lo:400:kworker.0 00000100:00100000:3.0:1782480932.774704:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388199680:0@lo:400:kworker.0 00000100:00100000:3.0:1782480932.774760:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480932.774798:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388200192:0@lo:400:kworker.0 00000100:00100000:3.0:1782480932.774822:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480932.774855:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:3.0:1782480932.774862:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388199552:0@lo:400:kworker.0 00000100:00100000:3.0:1782480932.774889:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480932.774909:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388200064:0@lo:400:kworker.0 00000100:00100000:3.0:1782480932.774932:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480932.775036:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388199680 00000100:00100000:2.0:1782480932.775043:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388199680 00000100:00100000:2.0:1782480932.775087:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388200064 00000100:00100000:2.0:1782480932.775091:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388200064 00000100:00100000:2.0:1782480932.775118:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782480932.775125:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388199680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480932.775207:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1869066388199680:12345-0@lo:400:kworker.0 Request processed in 82us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480932.775214:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 199 00000100:00100000:2.0:1782480932.775231:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1782480932.775237:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388200064:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480932.775263:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388200064:12345-0@lo:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480932.775268:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:2.0:1782480932.775286:0:6607:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388200192 00000100:00100000:2.0:1782480932.775305:0:6607:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388200192 00000100:00100000:2.0:1782480932.775330:0:6607:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782480932.775336:0:6607:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388200192:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480932.775366:0:6607:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388200192:12345-0@lo:400:kworker.0 Request processed in 29us (542us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480932.775371:0:6607:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1782480932.775404:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388200064:0@lo:400:kworker.0 00000100:00100000:2.0:1782480932.775414:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7f4ddc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1869066388199680:0@lo:400:kworker.0 00000100:00100000:2.0:1782480932.775423:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388200192:0@lo:400:kworker.0 00000100:00100000:1.0:1782480932.776129:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1782480932.776144:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388200320:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782480932.776197:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480932.776232:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388200320 00000100:00100000:1.0:1782480932.776237:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388200320 00000100:00100000:1.0:1782480932.776271:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782480932.776279:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388200320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782480932.776325:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782480932.776366:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388200320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (167us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480932.776373:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1782480932.776411:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388200320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782480932.778545:0:5797:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388199552 00000100:00100000:0.0:1782480932.778560:0:5797:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388199552 00000100:00100000:0.0:1782480932.778646:0:5797:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 314 00000100:00100000:0.0:1782480932.778700:0:5797:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388199552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782480932.778795:0:5797:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8052050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388199552:12345-0@lo:400:kworker.0 Request processed in 139us (3903us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480932.778802:0:5797:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 314 00000100:00080000:0.0:1782480932.778844:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480932.778851:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782480932.779224:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388199552:0@lo:400:kworker.0 00010000:00010000:3.0:1782480932.831015:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782480933.351081:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000001:00080000:1.0:1782480933.351109:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1782480933.351140:0:5825:0:(genops.c:906:class_export_put()) final put ffff91d7ef6c2000/227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:2.0:1782480933.351207:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ef6c2000/227f6c69-cfd7-4cc4-bae6-15b91431c78c for lustre-MDT0000 00000020:00000080:2.0:1782480933.351310:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ed06d000 for lustre-MDT0000 00000001:00100000:0.0:1782480933.834576:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:0.0:1782480933.834614:0:6632:0:(genops.c:906:class_export_put()) final put ffff91d7d1fcc000/227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:3.0:1782480933.834697:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7d1fcc000/227f6c69-cfd7-4cc4-bae6-15b91431c78c for lustre-OST0000 00000020:00000080:3.0:1782480933.834773:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7efc98800 for lustre-OST0000 00010000:00010000:0.0:1782480933.855003:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782480934.702159:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480934.702204:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782480934.702254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480934.702534:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366198784 00000100:00100000:0.0:1782480934.702545:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366198784 00000100:00100000:0.0:1782480934.705774:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366199040 00000100:00100000:0.0:1782480934.705788:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366199040 00000100:00100000:2.0:1782480934.705978:0:5786:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366198912 00000100:00100000:2.0:1782480934.705986:0:5786:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366198912 00000100:00100000:2.0:1782480934.706021:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:2.0:1782480934.706030:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+12:2351:x1869066366198784:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480934.706063:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480934.706084:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802058a00/0x4776e02a9acf517b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbb2 expref: 12 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480934.706104:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480934.708069:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+11:2351:x1869066366198784:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 2028us (5918us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480934.708081:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:2.0:1782480934.708128:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:2.0:1782480934.708138:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+10:2351:x1869066366199040:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480934.708370:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480934.708393:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7fee2c800/0x4776e02a9acf5342 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fc61 expref: 10 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480934.708419:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480934.708452:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+9:2351:x1869066366199040:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 318us (6247us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480934.708459:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:2.0:1782480934.708475:0:5786:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:2.0:1782480934.708482:0:5786:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+8:2351:x1869066366198912:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782480934.708490:0:5786:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782480934.708501:0:5786:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297ae00/0x4776e02a9acf5182 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fbdc expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480934.708509:0:5786:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782480934.708526:0:5786:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:a3a65011-408e-4936-8eb0-c95e426cdd7c+7:2351:x1869066366198912:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 45us (6272us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480934.708545:0:5786:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:1.0:1782480934.717613:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782480934.717794:0:5803:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366199296 00000100:00100000:2.0:1782480934.717815:0:5803:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366199296 00000100:00100000:2.0:1782480934.717896:0:5803:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 241 00000100:00100000:2.0:1782480934.717907:0:5803:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+6:2349:x1869066366199296:12345-192.168.201.58@tcp:39:umount.0 00000020:00000080:2.0:1782480934.717962:0:5803:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf5190 00000020:00010000:2.0:1782480934.717971:0:5803:0:(genops.c:1942:obd_stale_export_put()) Put export ffff91d7ed06f000: total 0 00000100:00080000:2.0:1782480934.717977:0:5803:0:(import.c:65:import_set_state_nolock()) ffff91d7ed068800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782480934.718006:0:5803:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000020:00010000:3.0:1782480934.718088:0:5789:0:(genops.c:1928:obd_stale_export_get()) Get export ffff91d7ed06f000: total 0 00010000:00010000:3.0:1782480934.718099:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480934.718198:0:5789:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91d7ed06f000, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1782480934.718266:0:5789:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c32f3300) 00010000:00010000:3.0:1782480934.718272:0:5789:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782480934.718287:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf60bd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0012 expref: 5 pid: 5802 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480934.718432:0:5789:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91d7ed06f000, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1782480934.718462:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480934.718466:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480934.718468:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480934.718535:0:5803:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef5ab800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:da13206b-be2f-48d4-ba4f-8aa0d1f46dad+3:2349:x1869066366199296:12345-192.168.201.58@tcp:39:umount.0 Request processed in 626us (939us total) trans 4294967527 rc 0/0 00000100:00100000:2.0:1782480934.718543:0:5803:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 241 00000100:00080000:1.0:1782480934.718712:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782480934.751495:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782480934.752817:0:5796:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366199552 00000100:00100000:0.0:1782480934.752850:0:5796:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366199552 00000100:00100000:0.0:1782480934.752931:0:5796:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 315 00000100:00100000:0.0:1782480934.752943:0:5796:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+7:2349:x1869066366199552:12345-192.168.201.58@tcp:251:umount.0 00000020:00000080:0.0:1782480934.753005:0:5796:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf5086 00000020:00010000:0.0:1782480934.753014:0:5796:0:(genops.c:1942:obd_stale_export_put()) Put export ffff91d7ef6c6800: total 0 00000100:00080000:0.0:1782480934.753019:0:5796:0:(import.c:65:import_set_state_nolock()) ffff91d7ef6c1800 : changing import state from FULL to CLOSED 00000100:00100000:0.0:1782480934.753111:0:5796:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8053450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:a3a65011-408e-4936-8eb0-c95e426cdd7c+3:2349:x1869066366199552:12345-192.168.201.58@tcp:251:umount.0 Request processed in 171us (1632us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480934.753120:0:5796:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 315 00000020:00010000:2.0:1782480934.754006:0:5790:0:(genops.c:1928:obd_stale_export_get()) Get export ffff91d7ef6c6800: total 0 00010000:00010000:2.0:1782480934.754095:0:5790:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91d7ef6c6800, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1782480934.754161:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a2000/0x4776e02a9acf50da lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d99fba4 expref: 2 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480934.754184:0:5790:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91d7ef6c6800, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1782480934.754194:0:5790:0:(genops.c:906:class_export_put()) final put ffff91d7ef6c6800/a3a65011-408e-4936-8eb0-c95e426cdd7c 00010000:00010000:2.0:1782480934.754221:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480934.754224:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480934.754225:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782480934.755348:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ef6c6800/a3a65011-408e-4936-8eb0-c95e426cdd7c for MGS 00000020:00000080:0.0:1782480934.755422:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ef6c1800 for MGS 00010000:00010000:0.0:1782480934.879087:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480935.336091:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1782480935.336117:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388200448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782480935.336203:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480935.336300:0:6611:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388200448 00000100:00100000:2.0:1782480935.336323:0:6611:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388200448 00000100:00100000:2.0:1782480935.336381:0:6611:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1782480935.336402:0:6611:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388200448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782480935.336440:0:6611:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782480935.336487:0:6611:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4ddc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388200448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480935.336496:0:6611:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:2.0:1782480935.336518:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480935.336556:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df4a8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388200448:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1782480935.902914:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782480936.462931:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:3.0:1782480936.462946:0:7517:0:(genops.c:906:class_export_put()) final put ffff91d7c9863800/227f6c69-cfd7-4cc4-bae6-15b91431c78c 00000020:00000080:3.0:1782480936.462995:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c9863800/227f6c69-cfd7-4cc4-bae6-15b91431c78c for lustre-OST0001 00000020:00000080:3.0:1782480936.463049:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7c9866000 for lustre-OST0001 00010000:00010000:0.0:1782480936.928097:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1782480937.019066:0:12853:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782480937.047213:0:12853:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1782480937.047320:0:12853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.047335:0:12853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.047343:0:12853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.047349:0:12853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.047406:0:12853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782480937.047412:0:12853:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782480937.047436:0:12853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782480937.047441:0:12853:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782480937.047446:0:12853:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782480937.047474:0:12853:0:(import.c:65:import_set_state_nolock()) ffff91d7ff090800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1782480937.047545:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869066388200576:0@lo:39:umount.0 00000100:00100000:1.0:1782480937.047627:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480937.047778:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388200576 00000100:00100000:2.0:1782480937.047785:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388200576 00000100:00100000:2.0:1782480937.047865:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1782480937.047876:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869066388200576:12345-0@lo:39:umount.0 00000020:00000080:2.0:1782480937.047904:0:5802:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4e95 00000100:00080000:2.0:1782480937.047911:0:5802:0:(import.c:65:import_set_state_nolock()) ffff91d7c4af7800 : changing import state from FULL to CLOSED 00010000:00010000:0.0:1782480937.047963:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480937.047970:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480937.047979:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c13a2e00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480937.047983:0:8324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480937.047993:0:8324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480937.048006:0:8324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480937.048011:0:8324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782480937.048014:0:8324:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782480937.048016:0:8324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782480937.048051:0:8324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480937.048058:0:8324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480937.048077:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480937.048084:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2e00/0x4776e02a9acf5119 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5120 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480937.048094:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480937.048096:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480937.048098:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480937.048116:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480937.048127:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7df9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388200704:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480937.048163:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480937.048199:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388200704 00000100:00100000:0.0:1782480937.048203:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388200704 00000100:00100000:0.0:1782480937.048238:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782480937.048244:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3313:x1869066388200704:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480937.048762:0:5788:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480937.048782:0:5788:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167ac00/0x4776e02a9acf5120 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf5119 expref: 19 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480937.048806:0:5788:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480937.048854:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10f3850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3313:x1869066388200704:12345-0@lo:103:ldlm_bl.0 Request processed in 609us (689us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480937.048862:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1782480937.048939:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7df9f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388200704:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480937.050970:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e77800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1869066388200576:12345-0@lo:39:umount.0 Request processed in 3089us (3335us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480937.050982:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:2.0:1782480937.050996:0:5802:0:(genops.c:906:class_export_put()) final put ffff91d7c4af4800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:3.0:1782480937.051029:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782480937.051099:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7ff090800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1782480937.051127:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869066388200576:0@lo:39:umount.0 00000100:00080000:3.0:1782480937.051263:0:12853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782480937.051267:0:12853:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782480937.051272:0:12853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1782480937.052171:0:12853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052187:0:12853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052194:0:12853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052202:0:12853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052224:0:12853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782480937.052230:0:12853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052236:0:12853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052241:0:12853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052246:0:12853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052258:0:12853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782480937.052277:0:12853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052282:0:12853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052288:0:12853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052293:0:12853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052309:0:12853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00010000:00010000:3.0:1782480937.052324:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1782480937.052330:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052337:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059000 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480937.052341:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052350:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480937.052375:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480937.052382:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480937.052385:0:5789:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:3.0:1782480937.052427:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052444:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480937.052463:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052470:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d802059000/0x4776e02a9acf5127 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf512e expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052486:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782480937.052489:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052495:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b000 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480937.052498:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052504:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480937.052511:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480937.052516:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480937.052518:0:5789:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:3.0:1782480937.052521:0:5789:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:3.0:1782480937.052533:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052538:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480937.052555:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052572:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d6c297b000/0x4776e02a9acf5040 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5047 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052589:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480937.052592:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052598:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a800 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480937.052601:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052607:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480937.052614:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480937.052619:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:3.0:1782480937.052621:0:5789:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:3.0:1782480937.052623:0:5789:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:3.0:1782480937.052637:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052642:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480937.052648:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052654:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d6c297a800/0x4776e02a9acf5334 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf533b expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052697:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480937.052699:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480937.052701:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480937.052715:0:12853:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052721:0:12853:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052727:0:12853:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052733:0:12853:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052745:0:12853:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782480937.052749:0:12853:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1782480937.052751:0:12853:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00010000:00010000:3.0:1782480937.052775:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782480937.052778:0:5789:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052784:0:5789:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0031e00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782480937.052787:0:5789:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052793:0:5789:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480937.052807:0:5789:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480937.052812:0:5789:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480937.052814:0:5789:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:3.0:1782480937.052815:0:5789:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:3.0:1782480937.052828:0:5789:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052834:0:5789:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782480937.052840:0:5789:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052846:0:5789:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c0031e00/0x4776e02a9acf4df4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf4dfb expref: -99 pid: 5782 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480937.052858:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480937.052860:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480937.052861:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782480937.052874:0:12853:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1782480937.052879:0:12853:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1782480937.052884:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480937.052891:0:12853:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1782480937.052899:0:12853:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff91d7df57a000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782480937.052904:0:12853:0:(genops.c:1840:print_export_data()) lustre-MDT0000: ACTIVE ffff91d7ef018800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782480937.052911:0:12853:0:(genops.c:1840:print_export_data()) lustre-MDT0000: UNLINKED ffff91d7ed06f000 da13206b-be2f-48d4-ba4f-8aa0d1f46dad 192.168.201.58@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782480937.052916:0:12853:0:(genops.c:1574:class_disconnect_exports()) OBD device 5 (ffff91d7c2c43380) has exports, disconnecting them 00000020:00080000:3.0:1782480937.052921:0:12853:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91d7df57a000), last request at 1782480932 00000020:00000080:3.0:1782480937.052934:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf5008 00000100:00080000:3.0:1782480937.052951:0:12853:0:(import.c:65:import_set_state_nolock()) ffff91d7df57b000 : changing import state from FULL to CLOSED 00010000:00010000:3.0:1782480937.052986:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:3.0:1782480937.052999:0:12853:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d7df57a000): rc 0 00000020:00000080:3.0:1782480937.053001:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7df57a000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:0.0:1782480937.053207:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480937.053225:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388201216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480937.053298:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480937.053342:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782480937.053347:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388200832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480937.053379:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480937.053411:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388201216 00000100:00100000:0.0:1782480937.053419:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388201216 00000100:00100000:0.0:1782480937.053463:0:5787:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388200832 00000100:00100000:0.0:1782480937.053466:0:5787:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388200832 00000100:00100000:0.0:1782480937.053486:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782480937.053494:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+19:3312:x1869066388201216:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480937.053508:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480937.053521:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167a000/0x4776e02a9acf4dfb lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf4df4 expref: 19 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480937.053536:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480937.053567:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+18:3312:x1869066388201216:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (269us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480937.053583:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1782480937.053602:0:5787:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782480937.053608:0:5787:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3312:x1869066388200832:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480937.053615:0:5787:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480937.053624:0:5787:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297ac00/0x4776e02a9acf512e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf5127 expref: 17 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480937.053632:0:5787:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480937.053654:0:5787:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3312:x1869066388200832:12345-0@lo:103:ldlm_bl.0 Request processed in 47us (275us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480937.053678:0:5787:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:0.0:1782480937.053701:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480937.053723:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388200832:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480937.053732:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388201216:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480937.053784:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388201088:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480937.053807:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480937.053824:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782480937.053829:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388200960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480937.053847:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480937.053868:0:12358:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388201088 00000100:00100000:0.0:1782480937.053871:0:12358:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388201088 00000100:00100000:0.0:1782480937.053892:0:12358:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388200960 00000100:00100000:0.0:1782480937.053894:0:12358:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388200960 00000100:00100000:0.0:1782480937.053908:0:12358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782480937.053914:0:12358:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58b05c0b-51b3-47cf-95bc-f3947e9ac894+17:3311:x1869066388201088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480937.053931:0:12358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480937.053940:0:12358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7fee2ce00/0x4776e02a9acf533b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf5334 expref: 17 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480937.053949:0:12358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480937.053975:0:12358:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58b05c0b-51b3-47cf-95bc-f3947e9ac894+16:3311:x1869066388201088:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (167us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480937.053981:0:12358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1782480937.053993:0:12358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480937.053999:0:12358:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58b05c0b-51b3-47cf-95bc-f3947e9ac894+15:3311:x1869066388200960:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480937.054006:0:12358:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480937.054014:0:12358:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf5047 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf5040 expref: 15 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480937.054028:0:12358:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480937.054048:0:12358:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:3311:x1869066388200960:12345-0@lo:103:ldlm_bl.0 Request processed in 49us (200us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480937.054054:0:12358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1782480937.054075:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388200960:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480937.054082:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3311:1869066388201088:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1782480937.054643:0:12853:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff91d7ef018800), last request at 1782480932 00000020:00000080:3.0:1782480937.054654:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4f3d 00000100:00080000:3.0:1782480937.054688:0:12853:0:(import.c:65:import_set_state_nolock()) ffff91d7ef01f800 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1782480937.054718:0:12853:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d7ef018800): rc 0 00000020:00000080:3.0:1782480937.054721:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7ef018800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1782480937.054738:0:12853:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb057410a7ae0 00000100:00080000:3.0:1782480937.054767:0:12853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782480937.054771:0:12853:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1782480937.054785:0:12853:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1782480937.054849:0:12853:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1782480937.054869:0:12853:0:(import.c:65:import_set_state_nolock()) ffff91d7eca08000 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1782480937.054885:0:12853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782480937.054888:0:12853:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1782480937.054901:0:12853:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:3.0:1782480937.054962:0:12853:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1782480937.054971:0:12853:0:(import.c:65:import_set_state_nolock()) ffff91d800641800 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:3.0:1782480937.055002:0:12853:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff91d7c2c43380) has no exports 00000100:00100000:0.0:1782480937.055406:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388201344:0@lo:9:umount.0 00000100:00100000:0.0:1782480937.055467:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480937.055510:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388201472:0@lo:9:umount.0 00000100:00100000:0.0:1782480937.055532:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480937.055572:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480937.055614:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388201344 00000100:00100000:2.0:1782480937.055621:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388201344 00000100:00100000:2.0:1782480937.055695:0:6608:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388201472 00000100:00100000:2.0:1782480937.055699:0:6608:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388201472 00000100:00100000:2.0:1782480937.055723:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782480937.055731:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869066388201344:12345-0@lo:9:umount.0 00000020:00000080:2.0:1782480937.055754:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4f91 00000100:00080000:2.0:1782480937.055760:0:6608:0:(import.c:65:import_set_state_nolock()) ffff91d6c29a7800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782480937.055794:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967324 00000100:00080000:0.0:1782480937.056140:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782480937.056150:0:5798:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782480937.056457:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1869066388201344:12345-0@lo:9:umount.0 Request processed in 723us (985us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480937.056464:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1782480937.056484:0:6608:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1782480937.056491:0:6608:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1869066388201472:12345-0@lo:9:umount.0 00000020:00000080:2.0:1782480937.056504:0:6608:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf5071 00000100:00080000:2.0:1782480937.056510:0:6608:0:(import.c:65:import_set_state_nolock()) ffff91d7ef6c4000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1782480937.056533:0:6608:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1782480937.056768:0:6608:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df9f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1869066388201472:12345-0@lo:9:umount.0 Request processed in 277us (1233us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480937.056776:0:6608:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1782480937.056803:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480937.056807:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782480937.057000:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7eca08000 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1782480937.057021:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1782480937.057024:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782480937.057028:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388201344:0@lo:9:umount.0 00000100:00080000:0.0:1782480937.057047:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d800641800 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1782480937.057052:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1782480937.057053:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1782480937.057055:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388201472:0@lo:9:umount.0 00000020:00000080:1.0:1782480937.057337:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c4af4800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1782480937.057946:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7df57a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:1.0:1782480937.058217:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ef018800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:1.0:1782480937.058364:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7c4af7800 for lustre-MDT0000 00000020:00000080:1.0:1782480937.058370:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7df57b000 for lustre-MDT0000 00000020:00000080:1.0:1782480937.058374:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ef01f800 for lustre-MDT0000 00000020:00080000:3.0:1782480937.065707:0:12853:0:(genops.c:1579:class_disconnect_exports()) OBD device 5 (ffff91d7c2c43380) has no exports 00000020:00000080:3.0:1782480937.126744:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4e4f 00000020:00000080:3.0:1782480937.126760:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d800548800/lustre-QMT0000_UUID 00000020:01000000:3.0:1782480937.126781:0:12853:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1782480937.127381:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480937.127394:0:12853:0:(obd_config.c:955:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782480937.127400:0:12853:0:(genops.c:1579:class_disconnect_exports()) OBD device 7 (ffff91d7c2d019c0) has no exports 00000020:00000080:0.0:1782480937.127614:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d800548800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:2.0:1782480937.127739:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4e48 00000020:00000080:2.0:1782480937.127747:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7c52a6800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1782480937.127798:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c52a6800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782480937.127800:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480937.127810:0:12853:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1782480937.127813:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7c52a2800/lustre-QMT0000_UUID 00000020:00000080:2.0:1782480937.127815:0:12853:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c52a2800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1782480937.127825:0:12853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000100:00100000:1.0:1782480937.891422:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782480937.891435:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388201728:0@lo:400:kworker.0 00000100:00100000:1.0:1782480937.891460:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388201600:0@lo:400:kworker.0 00000100:00100000:0.0:1782480937.892283:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388201856:0@lo:400:kworker.0 00000100:00100000:2.0:1782480937.895553:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480937.895739:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388201728 00000100:00100000:3.0:1782480937.895749:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388201728 00000100:00100000:3.0:1782480937.895818:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1782480937.895826:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1869066388201728:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1782480937.895849:0:5804:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1782480937.895900:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df4a8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3310:x1869066388201728:12345-0@lo:400:kworker.0 Request processed in 73us (356us total) trans 0 rc -107/-107 00000100:00100000:3.0:1782480937.895907:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1782480937.897802:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480937.898059:0:5794:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388201600 00000100:00100000:3.0:1782480937.898067:0:5794:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388201600 00000100:00100000:3.0:1782480937.898169:0:5794:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 316 00000100:00100000:3.0:1782480937.898180:0:5794:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c8050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:3312:x1869066388201600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480937.898320:0:5794:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c8050c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:58b05c0b-51b3-47cf-95bc-f3947e9ac894+14:3312:x1869066388201600:12345-0@lo:400:kworker.0 Request processed in 142us (524us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480937.898328:0:5794:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 316 00000100:00100000:1.0:1782480937.898412:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3312:1869066388201600:0@lo:400:kworker.0 00000100:00080000:2.0:1782480937.899155:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1782480937.899163:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91d7ff095000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:2.0:1782480937.899167:0:3310:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:0.0:1782480937.908916:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480937.912824:0:6840:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388201856 00000100:00100000:3.0:1782480937.912843:0:6840:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388201856 00000100:00100000:3.0:1782480937.912939:0:6840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1782480937.912950:0:6840:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1869066388201856:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1782480937.912962:0:6840:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1782480937.913059:0:6840:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3311:x1869066388201856:12345-0@lo:400:kworker.0 Request processed in 109us (4153us total) trans 0 rc -107/-107 00000100:00100000:3.0:1782480937.913067:0:6840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1782480937.913097:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1782480937.913104:0:3311:0:(import.c:65:import_set_state_nolock()) ffff91d7ed06c800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1782480937.913108:0:3311:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1782480937.913113:0:3311:0:(import.c:65:import_set_state_nolock()) ffff91d7ed06c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782480937.913117:0:3311:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 251 00000100:00080000:0.0:1782480937.913123:0:3311:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91d7ed06c800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1782480937.913160:0:3311:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7ff0b2a00 x1869066388201984/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782480937.913202:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388201856:0@lo:400:kworker.0 00000100:00100000:1.0:1782480937.913769:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1869066388201984:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:1.0:1782480937.913818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480937.915861:0:5804:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388201984 00000100:00100000:3.0:1782480937.915876:0:5804:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388201984 00000100:00100000:3.0:1782480937.915953:0:5804:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:3.0:1782480937.915962:0:5804:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1869066388201984:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1782480937.915983:0:5804:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:2.0:1782480937.919734:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91d7ff095000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782480937.919749:0:3310:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 229 00000100:00080000:2.0:1782480937.919766:0:3310:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91d7ff095000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1782480937.919830:0:3310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7c30fd180 x1869066388202112/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782480937.919888:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388201728:0@lo:400:kworker.0 00000100:00100000:1.0:1782480937.920554:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1869066388202112:0@lo:38:ptlrpcd_00_00.0 00000100:00100000:1.0:1782480937.920713:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480937.920938:0:5802:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388202112 00000100:00100000:0.0:1782480937.920950:0:5802:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388202112 00000100:00100000:0.0:1782480937.921028:0:5802:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:0.0:1782480937.921038:0:5802:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1869066388202112:12345-0@lo:38:ptlrpcd_00_00.0 00010000:02000000:0.0:1782480937.921074:0:5802:0:(ldlm_lib.c:1192:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:0.0:1782480937.921142:0:5802:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e74a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1869066388202112:12345-0@lo:38:ptlrpcd_00_00.0 Request processed in 103us (429us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782480937.921150:0:5802:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1782480937.921712:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7ff095000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782480937.922580:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782480937.922587:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1869066388202112:0@lo:38:ptlrpcd_00_00.0 00000100:00080000:2.0:1782480937.948073:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7ed06c800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782480937.948090:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782480937.948096:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1869066388201984:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:3.0:1782480937.949361:0:5804:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1869066388201984:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 31048us (33191us total) trans 0 rc -19/-19 00000100:00100000:3.0:1782480937.949386:0:5804:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00010000:00010000:0.0:1782480937.951925:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782480938.449044:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of da13206b-be2f-48d4-ba4f-8aa0d1f46dad 00000001:00080000:1.0:1782480938.449065:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1782480938.449071:0:5825:0:(genops.c:906:class_export_put()) final put ffff91d7ed06f000/da13206b-be2f-48d4-ba4f-8aa0d1f46dad 00000020:00000080:2.0:1782480938.449160:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ed06f000/da13206b-be2f-48d4-ba4f-8aa0d1f46dad for lustre-MDT0000 00000020:00000080:2.0:1782480938.449225:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ed068800 for lustre-MDT0000 00010000:00010000:1.0:1782480938.977844:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1782480939.035345:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782480939.035359:0:6632:0:(genops.c:906:class_export_put()) final put ffff91d6c29a6800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782480939.035394:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d6c29a6800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:2.0:1782480939.035443:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d6c29a7800 for lustre-OST0000 00000020:01000000:2.0:1782480939.167159:0:12853:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91d7ed0f87e0 - data ffff91d7db7e55e8/ffff91d7ef353000 00000020:01000000:2.0:1782480939.167314:0:12853:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91d7c661d780 - data ffff91d7db660af8/ffff91d7f4daa800 00000001:00000004:2.0:1782480939.177032:0:12853:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:1.0:1782480939.366523:0:12853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:1.0:1782480939.366531:0:12853:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1782480939.366554:0:12853:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782480939.366557:0:12853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782480939.369460:0:6838:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782480939.369472:0:6838:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 8 count 1 00000040:00080000:2.0:1782480939.369490:0:6838:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1782480939.371105:0:12853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1782480939.371115:0:12853:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:1.0:1782480939.371138:0:12853:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1782480939.371142:0:12853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1782480939.373793:0:7850:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1782480939.373801:0:7850:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 5 count 1 00000040:00080000:2.0:1782480939.373814:0:7850:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1782480939.492466:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4e17 00000020:00000080:2.0:1782480939.492479:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7c92f7800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782480939.492807:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c92f7800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782480939.505402:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4e2c 00000020:00000080:3.0:1782480939.505419:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7ff0b9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782480939.505475:0:12853:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:3.0:1782480939.505486:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480939.505495:0:12853:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782480939.505499:0:12853:0:(genops.c:1579:class_disconnect_exports()) OBD device 4 (ffff91d7c2c40000) has no exports 00000004:01000000:3.0:1782480939.506905:0:12853:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:3.0:1782480939.506919:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf506a 00000020:00000080:3.0:1782480939.506928:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7df543000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782480939.507295:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ff0b9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1782480939.517921:0:12853:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782480939.517997:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480939.518049:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7df543000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1782480939.518814:0:12853:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782480939.518824:0:12853:0:(genops.c:1579:class_disconnect_exports()) OBD device 17 (ffff91d7f4cc19c0) has no exports 00000020:00000080:3.0:1782480939.518834:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf5063 00000020:00000080:3.0:1782480939.518843:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7ff094800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782480939.518927:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ff094800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1782480939.519450:0:12853:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:3.0:1782480939.519455:0:12853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1782480939.519459:0:12853:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:3.0:1782480939.519465:0:12853:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782480939.519468:0:12853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782480939.519501:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480939.519512:0:12853:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782480939.519519:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4f83 00000020:00000080:3.0:1782480939.519524:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d800646000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:3.0:1782480939.519528:0:12853:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:3.0:1782480939.519532:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480939.519535:0:12853:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782480939.519537:0:12853:0:(genops.c:1579:class_disconnect_exports()) OBD device 13 (ffff91d7f4cc3380) has no exports 00000020:00000080:3.0:1782480939.519542:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4f7c 00000020:00000080:3.0:1782480939.519545:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7eca0f000/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1782480939.520575:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d800641800 for lustre-OST0001-osc-MDT0000 00000020:00000080:2.0:1782480939.520588:0:36:0:(genops.c:906:class_export_put()) final put ffff91d7ef6c5000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782480939.520591:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ef6c5000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:2.0:1782480939.520601:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1782480939.520721:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d800646000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1782480939.520727:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7eca0f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:3.0:1782480939.521219:0:12853:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:3.0:1782480939.521224:0:12853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1782480939.521241:0:12853:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:3.0:1782480939.521247:0:12853:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1782480939.521249:0:12853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782480939.521341:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480939.521352:0:12853:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782480939.521386:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480939.521389:0:12853:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782480939.521393:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7c92f3000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782480939.521396:0:12853:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c92f3000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:3.0:1782480939.521404:0:12853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782480939.521535:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4e33 00000020:00000080:3.0:1782480939.521541:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7f02c4000/lustre-MDD0000_UUID 00000020:00000080:2.0:1782480939.525386:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7eca08000 for lustre-OST0000-osc-MDT0000 00000020:00000080:2.0:1782480939.525405:0:36:0:(genops.c:906:class_export_put()) final put ffff91d7ef01d800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1782480939.525410:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ef01d800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:2.0:1782480939.525419:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1782480939.525756:0:12853:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:3.0:1782480939.525771:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480939.525781:0:12853:0:(obd_config.c:955:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1782480939.525786:0:12853:0:(genops.c:1579:class_disconnect_exports()) OBD device 6 (ffff91d7ff0c4d40) has no exports 00000020:00000080:3.0:1782480939.525823:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480939.525829:0:12853:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:3.0:1782480939.525836:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4e3a 00000020:00000080:3.0:1782480939.525843:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7f02c5000/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1782480939.525852:0:12853:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d7c52cd800 from lustre-MDT0000, refs=3 00000020:01000004:3.0:1782480939.525855:0:12853:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d7c52cd800 3 00000020:01000004:3.0:1782480939.525858:0:12853:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91d7c52cd800 from lustre-MDT0000 00000020:00000080:3.0:1782480939.525875:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480939.525879:0:12853:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:3.0:1782480939.525882:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7c92f6800/lustre-MDT0000_UUID 00000020:00000080:2.0:1782480939.526040:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7f02c4000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:2.0:1782480939.526046:0:36:0:(genops.c:906:class_export_put()) final put ffff91d7ff0bb000/lustre-MDD0000_UUID 00000020:00000080:2.0:1782480939.526048:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ff0bb000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:2.0:1782480939.526053:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:2.0:1782480939.526247:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7f02c5000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782480939.526276:0:12853:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c92f6800/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:3.0:1782480939.526284:0:12853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:3.0:1782480939.526331:0:12853:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:3.0:1782480939.526336:0:12853:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:3.0:1782480939.526339:0:12853:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:3.0:1782480939.526342:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480939.526355:0:12853:0:(obd_config.c:955:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782480939.526361:0:12853:0:(genops.c:1840:print_export_data()) MGS: ACTIVE ffff91d7c648f800 58b05c0b-51b3-47cf-95bc-f3947e9ac894 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782480939.526367:0:12853:0:(genops.c:1574:class_disconnect_exports()) OBD device 1 (ffff91d7c2d03380) has exports, disconnecting them 00000020:00080000:3.0:1782480939.526371:0:12853:0:(genops.c:1549:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff91d7c648f800), last request at 1782480681 00000020:00000080:3.0:1782480939.526385:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4dd8 00000020:00010000:3.0:1782480939.526389:0:12853:0:(genops.c:1942:obd_stale_export_put()) Put export ffff91d7c648f800: total 0 00000100:00080000:3.0:1782480939.526393:0:12853:0:(import.c:65:import_set_state_nolock()) ffff91d7c9394000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1782480939.526453:0:12853:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d7c648f800): rc 0 00000020:00080000:3.0:1782480939.526458:0:12853:0:(genops.c:1579:class_disconnect_exports()) OBD device 1 (ffff91d7c2d03380) has no exports 00000100:00100000:3.0:1782480939.526532:0:5796:0:(service.c:3182:ptlrpc_main()) ll_mgs_0001: service thread [ffff91d7d16f8e00:5796] 1 exiting: rc = 0 00000100:00100000:3.0:1782480939.526786:0:5794:0:(service.c:3182:ptlrpc_main()) ll_mgs_0000: service thread [ffff91d7c2d57600:5794] 0 exiting: rc = 1 00000100:00100000:1.0:1782480939.526925:0:5797:0:(service.c:3182:ptlrpc_main()) ll_mgs_0002: service thread [ffff91d7c76e6400:5797] 2 exiting: rc = 0 00000100:00100000:3.0:1782480939.529285:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529298:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529304:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529311:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529331:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529338:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529344:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529350:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529357:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529364:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529372:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529380:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529388:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529394:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529402:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529408:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529415:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529421:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529427:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529434:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529440:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529447:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529474:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529479:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529485:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529490:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529496:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529502:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529508:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529513:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529518:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529523:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529529:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529535:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529542:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529547:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529552:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529557:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529563:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529567:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529572:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529577:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529581:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529586:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529590:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529596:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529602:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529608:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529962:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529969:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529974:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529981:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529986:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529992:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.529997:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.530001:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.530007:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.530022:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.530026:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.530033:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.530038:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.530042:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.530047:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.530054:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:3.0:1782480939.530535:0:12853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782480939.530539:0:12853:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:00010000:2.0:1782480939.533808:0:8324:0:(genops.c:1928:obd_stale_export_get()) Get export ffff91d7c648f800: total 0 00010000:00010000:2.0:1782480939.534024:0:8324:0:(ldlm_lock.c:2652:ldlm_export_cancel_blocked_locks()) Export ffff91d7c648f800, canceled 0 locks, left on hash table 8. 00010000:00010000:2.0:1782480939.534062:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c0030600/0x4776e02a9acf4ef0 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf4ee9 expref: 9 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480939.534106:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167ba00/0x4776e02a9acf532d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf5326 expref: 8 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480939.534117:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c167b400/0x4776e02a9acf513c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf5135 expref: 7 pid: 5796 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480939.534128:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297bc00/0x4776e02a9acf50e8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf50e1 expref: 6 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480939.534142:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297aa00/0x4776e02a9acf50f6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf50ef expref: 5 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480939.534152:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7fee2c000/0x4776e02a9acf531f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf5318 expref: 4 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480939.534164:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a3a00/0x4776e02a9acf5104 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf50fd expref: 3 pid: 5797 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480939.534174:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c13a3600/0x4776e02a9acf5112 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x4776e02a9acf510b expref: 2 pid: 5794 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480939.534183:0:8324:0:(ldlm_lock.c:2680:ldlm_export_cancel_locks()) Export ffff91d7c648f800, canceled 8 locks, left on hash table 0. 00000020:00000080:2.0:1782480939.534196:0:8324:0:(genops.c:906:class_export_put()) final put ffff91d7c648f800/58b05c0b-51b3-47cf-95bc-f3947e9ac894 00010000:00010000:2.0:1782480939.534221:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480939.534223:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480939.534225:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1782480939.534278:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c648f800/58b05c0b-51b3-47cf-95bc-f3947e9ac894 for MGS 00000020:00000080:3.0:1782480939.534326:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7c9394000 for MGS 00000020:01000000:3.0:1782480939.538159:0:12853:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91d7fb077d80 - data ffff91d7ddffe948/ffff91d7ed311000 00000020:01000000:3.0:1782480939.538291:0:12853:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91d7c770cf00 - data ffff91d7ddf0aaf8/ffff91d7d1e92400 00000020:00000080:3.0:1782480939.538863:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4dbc 00000020:00000080:3.0:1782480939.538873:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7d6cce800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1782480939.538890:0:12853:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d7c52cd800 from MGS, refs=2 00000020:01000004:3.0:1782480939.538893:0:12853:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d7c52cd800 2 00000020:01000004:3.0:1782480939.538896:0:12853:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91d7c52cd800 from MGS 00000020:00000080:3.0:1782480939.538918:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480939.538924:0:12853:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1782480939.538926:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7c984d800/MGS 00000020:00000080:3.0:1782480939.538929:0:12853:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c984d800/MGS for MGS 00000020:01000000:3.0:1782480939.538935:0:12853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1782480939.538988:0:12853:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1782480939.538992:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480939.538997:0:12853:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782480939.539004:0:12853:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff91d7ff092000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782480939.539010:0:12853:0:(genops.c:1574:class_disconnect_exports()) OBD device 8 (ffff91d7f4cc0000) has exports, disconnecting them 00000020:00080000:3.0:1782480939.539014:0:12853:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff91d7ff092000), last request at 1782480682 00000020:00000080:3.0:1782480939.539017:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4e87 00000020:00080000:3.0:1782480939.539026:0:12853:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d7ff092000): rc 0 00000020:00000080:3.0:1782480939.539030:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7ff092000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782480939.539444:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7d6cce800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1782480939.539453:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ff092000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1782480939.679458:0:12853:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1782480939.679482:0:12853:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782480939.679487:0:12853:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782480939.679496:0:12853:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1782480939.679572:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ff090800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1782480939.679716:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480939.679736:0:12853:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1782480939.679743:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7f02c0000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1782480939.679747:0:12853:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7f02c0000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1782480939.679758:0:12853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1782480939.679820:0:12853:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d7c52cd800 1 00000020:00000080:2.0:1782480939.679826:0:12853:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4dae 00000020:00000080:2.0:1782480939.679833:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7c984a000/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1782480939.679844:0:12853:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1782480939.679848:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480939.679852:0:12853:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782480939.679855:0:12853:0:(genops.c:1579:class_disconnect_exports()) OBD device 0 (ffff91d7c2c44d40) has no exports 00000020:00000080:3.0:1782480939.679866:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c984a000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1782480939.762499:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480939.762517:0:12853:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:3.0:1782480939.762523:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7c77ce000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1782480939.762529:0:12853:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c77ce000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:3.0:1782480939.762540:0:12853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:3.0:1782480939.762721:0:12853:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff91d7c52ce800 00000020:01000000:3.0:1782480939.762749:0:12853:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:3.0:1782480939.762754:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480939.762759:0:12853:0:(obd_config.c:955:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782480939.762763:0:12853:0:(genops.c:1579:class_disconnect_exports()) OBD device 3 (ffff91d7c2c419c0) has no exports 00000100:00100000:3.0:1782480939.762859:0:5804:0:(service.c:3182:ptlrpc_main()) mdt00_002: service thread [ffff91d7c4b47600:5804] 2 exiting: rc = 0 00000100:00100000:2.0:1782480939.764859:0:5802:0:(service.c:3182:ptlrpc_main()) mdt00_000: service thread [ffff91d7c4b46c00:5802] 0 exiting: rc = 1 00000100:00100000:2.0:1782480939.764965:0:5803:0:(service.c:3182:ptlrpc_main()) mdt00_001: service thread [ffff91d7c4b47000:5803] 1 exiting: rc = 0 00000100:00100000:1.0:1782480939.766946:0:6840:0:(service.c:3182:ptlrpc_main()) mdt00_003: service thread [ffff91d7c5375a00:6840] 3 exiting: rc = 0 00000100:00100000:2.0:1782480939.767262:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767276:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767282:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767288:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767294:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767300:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767305:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767322:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767328:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767334:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767341:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767347:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767352:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767358:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767364:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767385:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767390:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767397:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767403:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767409:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767415:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767421:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767426:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767432:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767438:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767447:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767453:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767460:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767467:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767474:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767481:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767487:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767493:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767500:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767505:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767511:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767517:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767522:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767529:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767552:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767561:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767567:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767574:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767580:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767585:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767591:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767597:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767604:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767610:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767615:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767629:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767635:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767641:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767646:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767652:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767690:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767696:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767702:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767707:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767713:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767718:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767724:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767730:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.767745:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.784447:0:5805:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff91d7c4b47400:5805] 0 exiting: rc = 1 00000100:00100000:1.0:1782480939.786553:0:5806:0:(service.c:3182:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff91d7ea369400:5806] 1 exiting: rc = 0 00000100:00100000:2.0:1782480939.791091:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791106:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791114:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791122:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791128:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791136:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791143:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791150:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791173:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791181:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791187:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791194:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791221:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791227:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791234:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791241:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791246:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791252:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791258:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791264:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791270:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791299:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791306:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791322:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791328:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791334:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791340:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791346:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791352:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791358:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791364:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791370:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791376:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791382:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791387:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791393:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791399:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791405:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791410:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791416:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791421:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791427:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791433:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791439:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791445:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791450:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791456:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791461:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791467:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791473:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791479:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791485:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791490:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791496:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791502:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791507:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791522:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791529:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791536:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791541:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791546:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791552:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791559:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.791564:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.793001:0:5808:0:(service.c:3182:ptlrpc_main()) mdt_out00_001: service thread [ffff91d7c4b47c00:5808] 1 exiting: rc = 0 00000100:00100000:2.0:1782480939.793230:0:5807:0:(service.c:3182:ptlrpc_main()) mdt_out00_000: service thread [ffff91d7ea369c00:5807] 0 exiting: rc = 1 00000100:00100000:2.0:1782480939.793290:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793329:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793340:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793347:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793357:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793364:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793372:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793378:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793384:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793392:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793401:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793412:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793419:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793445:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793454:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793460:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793468:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793475:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793482:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793490:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793496:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793502:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793511:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793518:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793525:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793547:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793566:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793573:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793580:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793587:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793594:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793601:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793821:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793832:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793838:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793845:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793850:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793872:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793878:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793884:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793891:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793896:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793902:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793907:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793912:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793917:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793923:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793928:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793933:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793952:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793959:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793965:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793971:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793977:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793982:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793988:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.793995:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.794000:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.794006:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.794011:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.794016:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.794043:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.794049:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.794055:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480939.806129:0:5809:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0000: service thread [ffff91d7c4b46a00:5809] 0 exiting: rc = 1 00000100:00100000:3.0:1782480939.810033:0:5810:0:(service.c:3182:ptlrpc_main()) mdt_seqs_0001: service thread [ffff91d7c4b46800:5810] 1 exiting: rc = 0 00000100:00100000:2.0:1782480939.810297:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810305:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810323:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810328:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810334:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810339:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810344:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810350:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810356:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810361:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810368:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810373:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810378:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810384:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810389:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810395:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810401:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810406:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810411:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810416:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810422:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810427:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810432:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810439:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810444:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810450:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810455:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810460:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810466:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810471:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810477:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810482:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810506:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810512:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810518:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810525:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810530:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810536:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810542:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810548:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810554:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810560:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810566:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810571:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810577:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810584:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810591:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810596:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.810602:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813892:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813915:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813922:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813926:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813930:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813935:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813939:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813945:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813949:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813953:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813957:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813962:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813965:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813970:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.813975:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480939.815360:0:5812:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0001: service thread [ffff91d7c4bda400:5812] 1 exiting: rc = 0 00000100:00100000:3.0:1782480939.815524:0:5811:0:(service.c:3182:ptlrpc_main()) mdt_seqm_0000: service thread [ffff91d7c4bdbe00:5811] 0 exiting: rc = 1 00000100:00100000:2.0:1782480939.815840:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815848:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815853:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815874:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815879:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815885:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815890:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815896:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815902:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815906:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815912:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815917:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815922:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815926:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815932:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815936:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815941:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815945:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815950:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815954:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815958:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815963:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815968:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815972:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815977:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815982:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815987:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815992:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.815996:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816001:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816006:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816010:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816014:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816020:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816025:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816030:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816034:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816039:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816054:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816058:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816063:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816068:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816072:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816077:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816083:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816088:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816093:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816099:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816105:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816110:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816115:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816120:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816125:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816131:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816137:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816143:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816148:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816291:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816298:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816303:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816318:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816324:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816329:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.816334:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.821006:0:5814:0:(service.c:3182:ptlrpc_main()) mdt_fld_0001: service thread [ffff91d7c4bdac00:5814] 1 exiting: rc = 0 00000100:00100000:1.0:1782480939.821321:0:5813:0:(service.c:3182:ptlrpc_main()) mdt_fld_0000: service thread [ffff91d7c4bdae00:5813] 0 exiting: rc = 1 00000100:00100000:2.0:1782480939.823289:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823299:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823304:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823318:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823324:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823329:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823334:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823339:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823346:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823372:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823378:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823383:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823389:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823394:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823398:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823404:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823409:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823414:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823421:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823428:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823434:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823439:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823444:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823450:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823457:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823463:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823469:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823475:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823481:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823486:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823493:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823498:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823503:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823508:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823515:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823520:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823526:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823531:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823536:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823543:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823548:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823553:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823558:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823563:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823575:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823580:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823585:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823591:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823596:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.823602:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824248:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824259:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824265:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824271:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824276:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824281:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824286:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824291:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824296:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824301:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824306:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824322:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824328:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.824333:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1782480939.827017:0:5815:0:(service.c:3182:ptlrpc_main()) mdt_io00_000: service thread [ffff91d7c4bdb600:5815] 0 exiting: rc = 1 00000100:00100000:3.0:1782480939.828886:0:5817:0:(service.c:3182:ptlrpc_main()) mdt_io00_002: service thread [ffff91d7c4b46600:5817] 2 exiting: rc = 0 00000100:00100000:1.0:1782480939.830009:0:5816:0:(service.c:3182:ptlrpc_main()) mdt_io00_001: service thread [ffff91d7c4bdb200:5816] 1 exiting: rc = 0 00000100:00100000:2.0:1782480939.834008:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834017:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834043:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834049:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834054:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834060:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834067:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834072:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834078:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834084:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834090:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834095:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834100:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834105:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834112:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834132:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834137:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834142:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834711:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834727:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834734:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834743:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834749:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834760:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834768:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834774:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834780:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834787:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834794:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834799:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834805:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834810:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834817:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834823:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834829:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834856:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834864:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834870:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834876:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834881:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834887:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834893:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834900:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834905:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834911:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834916:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834923:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834928:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834933:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834938:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834952:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834957:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834963:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834968:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834973:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834978:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834984:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834990:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.834996:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.835001:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.835007:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.835013:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.835019:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480939.835027:0:12853:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:2.0:1782480939.845754:0:12853:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480939.845768:0:12853:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:2.0:1782480939.845774:0:12853:0:(genops.c:906:class_export_put()) final put ffff91d7c92f2000/MDS_uuid 00000020:00000080:2.0:1782480939.845779:0:12853:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c92f2000/MDS_uuid for MDS 00000020:01000000:2.0:1782480939.845785:0:12853:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:2.0:1782480939.845960:0:12853:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1782480940.004013:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480941.030703:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1782480941.580400:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1782480941.580410:0:7517:0:(genops.c:906:class_export_put()) final put ffff91d7ef6c6000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1782480941.580545:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ef6c6000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:1.0:1782480941.580601:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ef6c4000 for lustre-OST0001 00010000:00010000:2.0:1782480942.049635:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1782480943.008827:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782480943.008834:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782480943.008838:0:36:0:(import.c:65:import_set_state_nolock()) ffff91d7ff095000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782480943.008848:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 468 00000100:00080000:2.0:1782480943.008853:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782480943.008862:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91d7ff095000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1782480943.008901:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7c30ff480 x1869066388202368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782480943.008919:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:2.0:1782480943.008938:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:2.0:1782480943.008940:0:36:0:(import.c:65:import_set_state_nolock()) ffff91d7ed06c800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782480943.008944:0:36:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 468 00000100:00080000:2.0:1782480943.008947:0:36:0:(import.c:591:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782480943.008951:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91d7ed06c800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1782480943.008965:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7c30ffb80 x1869066388202496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782480943.008990:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1782480943.014555:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388202240:0@lo:400:kworker.0 00000400:00000100:2.0:1782480943.014632:0:3313:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869066388202240 offset 0 length 224: 4 00000100:00100000:2.0:1782480943.014711:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1869066388202368:0@lo:38:kworker.0 00000400:00000100:2.0:1782480943.014735:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066388202368 offset 0 length 520: 4 00000100:00100000:2.0:1782480943.014750:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1869066388202496:0@lo:38:kworker.0 00000400:00000100:2.0:1782480943.014766:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1869066388202496 offset 0 length 520: 4 00010000:00010000:2.0:1782480943.072033:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1782480943.380368:0:13006:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1782480943.408800:0:13006:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1782480943.408850:0:13006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.408864:0:13006:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.408872:0:13006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.408891:0:13006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.408914:0:13006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1782480943.408920:0:13006:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1782480943.408942:0:13006:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782480943.408955:0:13006:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d7c30ff480 x1869066388202368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782480958 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480943.408971:0:13006:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1782480943.408977:0:13006:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1782480943.408983:0:13006:0:(import.c:65:import_set_state_nolock()) ffff91d7ff095000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1782480943.408989:0:13006:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1782480943.408992:0:13006:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d7c30ff480 x1869066388202368/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782480958 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480943.409000:0:13006:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1782480943.409003:0:13006:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1782480943.409441:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782480943.409449:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480943.409459:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c13a3200 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:2.0:1782480943.409463:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480943.409473:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782480943.409493:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480943.409499:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1782480943.409502:0:5790:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1782480943.409505:0:5790:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1782480943.409553:0:5790:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480943.409560:0:5790:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782480943.409596:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480943.409603:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c13a3200/0x4776e02a9acf50fd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5104 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480943.409615:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480943.409617:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480943.409619:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782480943.409646:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1869066388202368:0@lo:38:kworker.0 00000100:00100000:3.0:1782480943.409692:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388202624:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782480943.409757:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480943.410197:0:12358:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388202624 00000100:00100000:2.0:1782480943.410205:0:12358:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388202624 00000100:00100000:2.0:1782480943.410262:0:12358:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782480943.410269:0:12358:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1869066388202624:12345-0@lo:103:ldlm_bl.0 00010000:00020000:2.0:1782480943.410275:0:12358:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782480943 with bad export cookie 5149549697535266264 00010000:00010000:3.0:1782480943.410703:0:13006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.410713:0:13006:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.410720:0:13006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.410741:0:13006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.410757:0:13006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782480943.410764:0:13006:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.410771:0:13006:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.410777:0:13006:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.410784:0:13006:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480943.410795:0:13006:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1782480943.410799:0:13006:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1782480943.410816:0:13006:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1782480943.410821:0:13006:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1782480943.410826:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480943.410831:0:13006:0:(obd_config.c:955:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1782480943.410835:0:13006:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff91d7ef048000) has no exports 00000020:00080000:3.0:1782480943.410861:0:13006:0:(genops.c:1579:class_disconnect_exports()) OBD device 11 (ffff91d7ef048000) has no exports 00000020:01000000:3.0:1782480943.412512:0:13006:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91d7fb0774e0 - data ffff91d7ef8c6438/ffff91d7ed312400 00000020:01000000:3.0:1782480943.412730:0:13006:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91d6c28fa420 - data ffff91d7db738438/ffff91d7ef21cc00 00010000:00010000:0.0:1782480943.420136:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782480943.420150:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480943.420163:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c13a2400 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480943.420167:0:8324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480943.420179:0:8324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480943.420186:0:8324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480943.420192:0:8324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782480943.420195:0:8324:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:0.0:1782480943.420199:0:8324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:0.0:1782480943.420240:0:8324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480943.426538:0:8324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480943.426594:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480943.426605:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2400/0x4776e02a9acf510b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf5112 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480943.426645:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388202752:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480943.426646:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480943.426650:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480943.426656:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779aa00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480943.426674:0:8324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480943.426684:0:8324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480943.426690:0:8324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480943.426696:0:8324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782480943.426699:0:8324:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782480943.426702:0:8324:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782480943.426734:0:8324:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480943.426739:0:8324:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1782480943.426742:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1782480943.426745:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480943.426751:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c779aa00/0x4776e02a9acf5326 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x4776e02a9acf532d expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480943.426759:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480943.426760:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480943.426768:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480943.426785:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388202752 00000100:00100000:1.0:1782480943.426789:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782480943.426791:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388202752 00000100:00100000:1.0:1782480943.426795:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388202880:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782480943.426815:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480943.426829:0:5788:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388202880 00000100:00100000:0.0:1782480943.426832:0:5788:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388202880 00000100:00100000:0.0:1782480943.426844:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480943.426851:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3310:x1869066388202752:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782480943.426856:0:5788:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782480943 with bad export cookie 5149549697535266264 00000100:00100000:0.0:1782480943.427338:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3310:x1869066388202752:12345-0@lo:103:ldlm_bl.0 Request processed in 484us (594us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782480943.427346:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1782480943.427363:0:5788:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782480943.427367:0:5788:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7d10f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3310:x1869066388202880:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1782480943.427371:0:5788:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1782480943 with bad export cookie 5149549697535266264 00000100:00100000:0.0:1782480943.427395:0:5788:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7d10f2450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:0+-99:3310:x1869066388202880:12345-0@lo:103:ldlm_bl.0 Request processed in 27us (579us total) trans 0 rc -107/-107 00000100:00100000:0.0:1782480943.427401:0:5788:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00010000:0.0:1782480943.427446:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782480943.427626:0:3310:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.158@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782480943.427638:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91d7d6cc9800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1782480943.427642:0:3310:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.201.158@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00100000:2.0:1782480943.432985:0:12358:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3313:x1869066388202624:12345-0@lo:103:ldlm_bl.0 Request processed in 22708us (23222us total) trans 0 rc -107/-107 00000100:00100000:2.0:1782480943.433008:0:12358:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1782480943.433163:0:3313:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.201.158@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1782480943.467353:0:3310:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.201.158@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1782480943.467359:0:3310:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1782480943.467369:0:3310:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d7c30fce00 x1869066388202240/t0(0) o400->MGC192.168.201.158@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1782480959 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480943.467385:0:3310:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d7c30fc700 x1869066388202624/t0(0) o103->MGC192.168.201.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782480959 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480943.467394:0:3310:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d7ff0b1f80 x1869066388202752/t0(0) o103->MGC192.168.201.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782480959 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480943.467402:0:3310:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d7ff0b1500 x1869066388202880/t0(0) o103->MGC192.168.201.158@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1782480959 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1782480943.467490:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1782480943.467494:0:3310:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1782480943.467496:0:3310:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1782480943.468609:0:3313:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff91d7d6cc9800 already not connected (conn 1, was 1): DISCONN 00000100:00100000:3.0:1782480943.471915:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388202240:0@lo:400:kworker.0 00000100:00100000:3.0:1782480943.471962:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3313:1869066388202624:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1782480943.472168:0:3310:0:(import.c:65:import_set_state_nolock()) ffff91d7d6cc9800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782480943.472174:0:3310:0:(import.c:512:import_select_connection()) MGC192.168.201.158@tcp: connect to NID 0@lo last attempt 212 00000100:00080000:1.0:1782480943.472183:0:3310:0:(import.c:626:import_select_connection()) MGC192.168.201.158@tcp: import ffff91d7d6cc9800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1782480943.472313:0:3310:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7ff0b2d80 x1869066388203008/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782480943.472350:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388202752:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480943.472364:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3310:1869066388202880:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480943.472412:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3309:1869066388203008:0@lo:250:ptlrpcd_00_00.0 00000400:00000100:2.0:1782480943.472461:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1869066388203008 offset 0 length 520: 4 00100000:10000000:3.0:1782480943.487628:0:13006:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1782480943.545746:0:13006:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4f0c 00000020:00000080:0.0:1782480943.545756:0:13006:0:(genops.c:906:class_export_put()) final put ffff91d800645000/lustre-OST0000-osd_UUID 00000020:01000004:0.0:1782480943.545769:0:13006:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d7c7ca2800 from lustre-OST0000, refs=2 00000020:01000004:0.0:1782480943.545773:0:13006:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d7c7ca2800 2 00000020:01000004:0.0:1782480943.545776:0:13006:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91d7c7ca2800 from lustre-OST0000 00000020:00000080:0.0:1782480943.545934:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1782480943.545947:0:13006:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:0.0:1782480943.545951:0:13006:0:(genops.c:906:class_export_put()) final put ffff91d7c7ca6800/lustre-OST0000_UUID 00000020:00000080:0.0:1782480943.545954:0:13006:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c7ca6800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:0.0:1782480943.545961:0:13006:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:0.0:1782480943.546007:0:13006:0:(obd_mount.c:569:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:0.0:1782480943.546011:0:13006:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:0.0:1782480943.546015:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1782480943.546019:0:13006:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1782480943.546026:0:13006:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff91d7fe506800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1782480943.546032:0:13006:0:(genops.c:1574:class_disconnect_exports()) OBD device 12 (ffff91d7ed218000) has exports, disconnecting them 00000020:00080000:0.0:1782480943.546036:0:13006:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff91d7fe506800), last request at 1782480698 00000020:00000080:0.0:1782480943.546040:0:13006:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4f36 00000020:00080000:0.0:1782480943.546049:0:13006:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d7fe506800): rc 0 00000020:00000080:0.0:1782480943.546057:0:13006:0:(genops.c:906:class_export_put()) final put ffff91d7fe506800/lustre-MDT0000-lwp-OST0000 00000020:00000080:2.0:1782480943.551192:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d800645000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:2.0:1782480943.551212:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7fe506800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:2.0:1782480943.552182:0:13006:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:2.0:1782480943.552189:0:13006:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782480943.552194:0:13006:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782480943.552202:0:13006:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1782480943.552377:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1782480943.552387:0:13006:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:2.0:1782480943.552396:0:13006:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d7c7ca2800 1 00000020:00000080:2.0:1782480943.552403:0:13006:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4ec6 00000020:00000080:2.0:1782480943.552414:0:13006:0:(genops.c:906:class_export_put()) final put ffff91d7c31bd800/lustre-OST0000-osd_UUID 00000020:01000000:2.0:1782480943.552420:0:13006:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:2.0:1782480943.552425:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1782480943.552429:0:13006:0:(obd_config.c:955:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1782480943.552432:0:13006:0:(genops.c:1579:class_disconnect_exports()) OBD device 9 (ffff91d7c2d00000) has no exports 00000020:00000080:3.0:1782480943.553023:0:36:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ff095000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1782480943.553031:0:36:0:(genops.c:906:class_export_put()) final put ffff91d7fe505000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:3.0:1782480943.553033:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7fe505000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:3.0:1782480943.553042:0:36:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:3.0:1782480943.553089:0:36:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c31bd800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1782480943.614268:0:13006:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480943.614286:0:13006:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:3.0:1782480943.614292:0:13006:0:(genops.c:906:class_export_put()) final put ffff91d7c7ca1800/lustre-OST0000-osd_UUID 00000020:00000080:3.0:1782480943.614297:0:13006:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c7ca1800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:3.0:1782480943.614315:0:13006:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:3.0:1782480943.614520:0:13006:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff91d7c7ca7000 00000020:02000400:3.0:1782480943.614587:0:13006:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:2.0:1782480944.098439:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480945.119519:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480946.144234:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1782480947.024086:0:13158:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1782480947.039169:0:13158:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1782480947.039275:0:13158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.039291:0:13158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.039298:0:13158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.039303:0:13158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.039380:0:13158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1782480947.039386:0:13158:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1782480947.039411:0:13158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782480947.039423:0:13158:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d7c30ffb80 x1869066388202496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782480958 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480947.039437:0:13158:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1782480947.039442:0:13158:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1782480947.039449:0:13158:0:(import.c:65:import_set_state_nolock()) ffff91d7ed06c800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:1.0:1782480947.039455:0:13158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1782480947.039458:0:13158:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d7c30ffb80 x1869066388202496/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1782480958 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782480947.039464:0:13158:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:1.0:1782480947.039466:0:13158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 14s for inflight to error out 00000100:00100000:2.0:1782480947.039537:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1869066388202496:0@lo:38:kworker.0 00010000:00010000:1.0:1782480947.040805:0:13158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.040820:0:13158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.040826:0:13158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.040832:0:13158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.041101:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782480947.041110:0:5790:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.041117:0:5790:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167a400 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480947.041121:0:5790:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.041129:0:5790:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480947.041136:0:5790:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480947.041155:0:5790:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782480947.041158:0:5790:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1782480947.041161:0:5790:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1782480947.041177:0:5790:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d7d6cc9800 00010000:00010000:0.0:1782480947.041191:0:5790:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.041197:0:5790:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167a400/0x4776e02a9acf50e1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4776e02a9acf50e8 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.041319:0:13158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782480947.041329:0:13158:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.041344:0:13158:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.041350:0:13158:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.041357:0:13158:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480947.041378:0:13158:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:1.0:1782480947.041383:0:13158:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:1.0:1782480947.041405:0:13158:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:1.0:1782480947.041409:0:13158:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:1.0:1782480947.041414:0:13158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782480947.041419:0:13158:0:(obd_config.c:955:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782480947.041422:0:13158:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff91d7ed21b380) has no exports 00000020:00080000:1.0:1782480947.041446:0:13158:0:(genops.c:1579:class_disconnect_exports()) OBD device 15 (ffff91d7ed21b380) has no exports 00010000:00010000:0.0:1782480947.043059:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782480947.043073:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.043085:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c13a2800 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480947.043089:0:8324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.043100:0:8324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480947.043108:0:8324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480947.043115:0:8324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1782480947.043117:0:8324:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:0.0:1782480947.043120:0:8324:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:0.0:1782480947.043136:0:8324:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d7d6cc9800 00010000:00010000:0.0:1782480947.043140:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.043162:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2800/0x4776e02a9acf50ef lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x4776e02a9acf50f6 expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.043176:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480947.043180:0:8324:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.043198:0:8324:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b800 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480947.043201:0:8324:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.043208:0:8324:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480947.043215:0:8324:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480947.043220:0:8324:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1782480947.043222:0:8324:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1782480947.043224:0:8324:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1782480947.043231:0:8324:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d7d6cc9800 00010000:00010000:0.0:1782480947.043234:0:8324:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.043240:0:8324:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167b800/0x4776e02a9acf5318 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x4776e02a9acf531f expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480947.043253:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480947.043255:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480947.043262:0:8324:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480947.043364:0:5789:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480947.043468:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480947.043472:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480947.043474:0:5790:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:1.0:1782480947.044023:0:13158:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91d7fb0770c0 - data ffff91d7db49aca8/ffff91d7ed311c00 00000020:01000000:1.0:1782480947.044170:0:13158:0:(lprocfs_status_server.c:306:lprocfs_free_client_stats()) stat ffff91d7c772a300 - data ffff91d6c160be58/ffff91d7ef3b3800 00100000:10000000:0.0:1782480947.068075:0:13158:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1782480947.084559:0:13158:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4fd7 00000020:00000080:3.0:1782480947.084568:0:13158:0:(genops.c:906:class_export_put()) final put ffff91d7ef1f3000/lustre-OST0001-osd_UUID 00000020:01000004:3.0:1782480947.084587:0:13158:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d6c29a2000 from lustre-OST0001, refs=2 00000020:01000004:3.0:1782480947.084591:0:13158:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d6c29a2000 2 00000020:01000004:3.0:1782480947.084594:0:13158:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff91d6c29a2000 from lustre-OST0001 00000020:00000080:3.0:1782480947.084618:0:13158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480947.084627:0:13158:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:3.0:1782480947.084630:0:13158:0:(genops.c:906:class_export_put()) final put ffff91d7ff094000/lustre-OST0001_UUID 00000020:00000080:3.0:1782480947.084632:0:13158:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ff094000/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:3.0:1782480947.084638:0:13158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:3.0:1782480947.084738:0:13158:0:(pinger.c:400:ptlrpc_pinger_del_import()) removing pingable import 58b05c0b-51b3-47cf-95bc-f3947e9ac894->MGS 00010000:00010000:3.0:1782480947.084754:0:13158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2200/0x4776e02a9acf4ee9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf4ef0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480947.084765:0:13158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2200/0x4776e02a9acf4ee9 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf4ef0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480947.084784:0:13158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:3.0:1782480947.084787:0:13158:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:3.0:1782480947.084790:0:13158:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:3.0:1782480947.084802:0:13158:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d7d6cc9800 00010000:00010000:3.0:1782480947.084805:0:13158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c13a2200/0x4776e02a9acf4ee9 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4776e02a9acf4ef0 expref: -99 pid: 6604 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480947.084819:0:13158:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c167a800/0x4776e02a9acf5135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x4776e02a9acf513c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782480947.084825:0:13158:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c167a800/0x4776e02a9acf5135 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x4776e02a9acf513c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480947.084830:0:13158:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1782480947.084832:0:13158:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:3.0:1782480947.084834:0:13158:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:3.0:1782480947.084852:0:13158:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff91d7d6cc9800 00010000:00010000:3.0:1782480947.084856:0:13158:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c167a800/0x4776e02a9acf5135 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x4776e02a9acf513c expref: -99 pid: 5799 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1782480947.084872:0:13158:0:(import.c:65:import_set_state_nolock()) ffff91d7d6cc9800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:3.0:1782480947.084876:0:13158:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:3.0:1782480947.084879:0:13158:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:3.0:1782480947.084881:0:13158:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:3.0:1782480947.084884:0:13158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:3.0:1782480947.084895:0:13158:0:(client.c:3588:ptlrpc_abort_inflight()) @@@ inflight req@ffff91d7ff0b2d80 x1869066388203008/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1782480953 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_00.0' uid:0 gid:0 projid:4294967295 10000000:01000000:3.0:1782480947.084909:0:13158:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1782480947.084912:0:13158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 8s for inflight to error out 00000020:00000080:1.0:1782480947.085049:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ef1f3000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000100:00100000:2.0:1782480947.085158:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:58b05c0b-51b3-47cf-95bc-f3947e9ac894:3309:1869066388203008:0@lo:250:ptlrpcd_00_00.0 10000000:01000000:3.0:1782480947.085229:0:13158:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:3.0:1782480947.085242:0:13158:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4dca 00000020:00000080:3.0:1782480947.085246:0:13158:0:(genops.c:906:class_export_put()) final put ffff91d7c92f4800/58b05c0b-51b3-47cf-95bc-f3947e9ac894 00000020:01000000:3.0:1782480947.085286:0:13158:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of MGC192.168.201.158@tcp (flags='') 00000020:00000080:3.0:1782480947.085291:0:13158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480947.085295:0:13158:0:(obd_config.c:955:class_cleanup()) MGC192.168.201.158@tcp: forcing exports to disconnect: 0/3 00000020:00080000:3.0:1782480947.085299:0:13158:0:(genops.c:1579:class_disconnect_exports()) OBD device 2 (ffff91d7c2d04d40) has no exports 10000000:01000000:2.0:1782480947.085829:0:5799:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:3.0:1782480947.086123:0:13158:0:(obd_class.h:671:obd_cleanup_client_import()) MGC192.168.201.158@tcp: client import never connected 00000100:00080000:3.0:1782480947.086127:0:13158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:3.0:1782480947.086130:0:13158:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:3.0:1782480947.086133:0:13158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:3.0:1782480947.086136:0:13158:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:1.0:1782480947.091463:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c92f4800/58b05c0b-51b3-47cf-95bc-f3947e9ac894 for MGC192.168.201.158@tcp 00000020:00000080:3.0:1782480947.091833:0:13158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1782480947.091845:0:13158:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.201.158@tcp (uuid 58b05c0b-51b3-47cf-95bc-f3947e9ac894) 00000020:01000000:3.0:1782480947.091862:0:13158:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:3.0:1782480947.091867:0:13158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1782480947.091873:0:13158:0:(obd_config.c:955:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1782480947.091881:0:13158:0:(genops.c:1840:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff91d7ed068000 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1782480947.091888:0:13158:0:(genops.c:1574:class_disconnect_exports()) OBD device 16 (ffff91d7ed21cd40) has exports, disconnecting them 00000020:00080000:3.0:1782480947.091893:0:13158:0:(genops.c:1549:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff91d7ed068000), last request at 1782480720 00000020:00000080:3.0:1782480947.091897:0:13158:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf5001 00000020:00080000:3.0:1782480947.091911:0:13158:0:(genops.c:1554:class_disconnect_export_list()) disconnected export at 0@lo (ffff91d7ed068000): rc 0 00000020:00000080:3.0:1782480947.091916:0:13158:0:(genops.c:906:class_export_put()) final put ffff91d7ed068000/lustre-MDT0000-lwp-OST0001 00000020:00000080:1.0:1782480947.092836:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7d6cc9800 for MGC192.168.201.158@tcp 00000020:00000080:1.0:1782480947.092846:0:37:0:(genops.c:906:class_export_put()) final put ffff91d7d6ccf800/58b05c0b-51b3-47cf-95bc-f3947e9ac894 00000020:00000080:1.0:1782480947.092849:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7d6ccf800/58b05c0b-51b3-47cf-95bc-f3947e9ac894 for MGC192.168.201.158@tcp 00000020:01000000:1.0:1782480947.092859:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.201.158@tcp (58b05c0b-51b3-47cf-95bc-f3947e9ac894) 00000020:00000080:1.0:1782480947.093114:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ed068000/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1782480947.112802:0:13158:0:(obd_class.h:671:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1782480947.112812:0:13158:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1782480947.112835:0:13158:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1782480947.112844:0:13158:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:1.0:1782480947.112959:0:37:0:(genops.c:1204:obd_zombie_import_free()) destroying import ffff91d7ed06c800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1782480947.114761:0:8324:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:1.0:1782480947.115014:0:5789:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1782480947.115255:0:5790:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1782480947.115392:0:5785:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_001: service thread [ffff91d7c7722200:5785] 1 exiting: rc = 0 00000100:00100000:1.0:1782480947.115478:0:8323:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_002: service thread [ffff91d7c2c1b400:8323] 2 exiting: rc = 0 00000100:00100000:2.0:1782480947.116280:0:5784:0:(service.c:3182:ptlrpc_main()) ldlm_cb00_000: service thread [ffff91d7ea368800:5784] 0 exiting: rc = 1 00000100:00100000:1.0:1782480947.116386:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.116679:0:5787:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_001: service thread [ffff91d7c7723c00:5787] 1 exiting: rc = 0 00000100:00100000:1.0:1782480947.116785:0:5788:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_002: service thread [ffff91d7c7722800:5788] 2 exiting: rc = 0 00000100:00100000:1.0:1782480947.118816:0:5786:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_000: service thread [ffff91d7c7723800:5786] 0 exiting: rc = 1 00000100:00100000:3.0:1782480947.119273:0:12358:0:(service.c:3182:ptlrpc_main()) ldlm_cn00_003: service thread [ffff91d7fe74d800:12358] 3 exiting: rc = 0 00000100:00100000:1.0:1782480947.119428:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119437:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119443:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119449:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119455:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119460:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119466:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119471:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119476:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119482:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119487:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119492:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119497:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119503:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119509:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119517:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119523:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119530:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119535:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119541:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119547:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119552:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119557:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119562:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119568:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119573:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119578:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119595:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119600:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119605:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119611:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119615:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119621:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119626:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119631:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119635:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119640:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119645:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119650:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119678:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119686:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119690:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119695:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119700:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119705:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119710:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119714:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119719:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119724:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119729:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119734:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119739:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119744:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119749:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119754:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119759:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119764:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119769:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119780:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119787:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119792:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119796:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119806:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.119811:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1782480947.120881:0:13158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782480947.120893:0:13158:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1782480947.120899:0:13158:0:(genops.c:906:class_export_put()) final put ffff91d7efc9a000/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1782480947.120904:0:13158:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7efc9a000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1782480947.120910:0:13158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1782480947.120951:0:13158:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d6c29a2000 1 00000020:00000080:1.0:1782480947.120957:0:13158:0:(genops.c:1489:class_disconnect()) disconnect: cookie 0x4776e02a9acf4fa6 00000020:00000080:1.0:1782480947.120963:0:13158:0:(genops.c:906:class_export_put()) final put ffff91d7ef6c0000/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1782480947.121940:0:13158:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1782480947.121950:0:13158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782480947.121956:0:13158:0:(obd_config.c:955:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1782480947.121960:0:13158:0:(genops.c:1579:class_disconnect_exports()) OBD device 14 (ffff91d7f4cc4d40) has no exports 00000020:00000080:2.0:1782480947.124407:0:37:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7ef6c0000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1782480947.173791:0:13158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782480947.173807:0:13158:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1782480947.173813:0:13158:0:(genops.c:906:class_export_put()) final put ffff91d6c29a4000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1782480947.173818:0:13158:0:(genops.c:865:class_export_destroy()) destroying export ffff91d6c29a4000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1782480947.173826:0:13158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1782480947.174027:0:13158:0:(obd_mount.c:659:lustre_free_lsi()) Freeing lsi ffff91d6c29a1000 00000020:01000000:1.0:1782480947.174065:0:13158:0:(obd_config.c:2475:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1782480947.174070:0:13158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1782480947.174073:0:13158:0:(obd_config.c:955:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1782480947.174077:0:13158:0:(genops.c:1579:class_disconnect_exports()) OBD device 10 (ffff91d7ed2199c0) has no exports 00000020:00000080:1.0:1782480947.174102:0:13158:0:(obd_config.c:1470:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1782480947.174108:0:13158:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1782480947.174111:0:13158:0:(genops.c:906:class_export_put()) final put ffff91d7c31ba000/OSS_uuid 00000020:00000080:1.0:1782480947.174113:0:13158:0:(genops.c:865:class_export_destroy()) destroying export ffff91d7c31ba000/OSS_uuid for OSS 00000020:01000000:1.0:1782480947.174117:0:13158:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:2.0:1782480947.182200:0:6607:0:(service.c:3182:ptlrpc_main()) ll_ost00_000: service thread [ffff91d80067ee00:6607] 0 exiting: rc = 1 00000100:00100000:2.0:1782480947.182307:0:8498:0:(service.c:3182:ptlrpc_main()) ll_ost00_003: service thread [ffff91d7df9d5600:8498] 3 exiting: rc = 0 00000100:00100000:2.0:1782480947.182382:0:6608:0:(service.c:3182:ptlrpc_main()) ll_ost00_001: service thread [ffff91d7c2c1a400:6608] 1 exiting: rc = 0 00000100:00080000:0.0:1782480947.182554:0:5798:0:(pinger.c:550:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:3.0:1782480947.187124:0:6609:0:(service.c:3182:ptlrpc_main()) ll_ost00_002: service thread [ffff91d7c2c1ac00:6609] 2 exiting: rc = 0 00000100:00100000:1.0:1782480947.187241:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187249:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187256:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187262:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187286:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187295:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187301:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187306:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187311:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187316:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187321:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187325:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187330:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187335:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187340:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187345:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187350:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187355:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187361:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187366:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187372:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187377:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187382:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187387:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187392:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187397:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187402:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187407:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187413:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187417:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187422:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187427:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187432:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187436:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187441:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187446:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187451:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187456:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187461:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187474:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187479:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187484:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187489:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187493:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187499:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187504:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187509:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187514:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187520:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187525:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187531:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187536:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187541:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187546:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187551:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187556:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187561:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187566:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187571:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187576:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187580:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187584:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187590:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1782480947.187595:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.189433:0:6610:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_000: service thread [ffff91d7c2c1ba00:6610] 0 exiting: rc = 1 00000100:00100000:3.0:1782480947.197369:0:6611:0:(service.c:3182:ptlrpc_main()) ll_ost_create00_001: service thread [ffff91d7c2c1bc00:6611] 1 exiting: rc = 0 00000100:00100000:2.0:1782480947.197714:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197723:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197729:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197734:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197740:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197745:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197750:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197755:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197760:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197765:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197770:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197776:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197782:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197787:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197793:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197798:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197804:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197809:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197813:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197818:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197823:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197828:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197833:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197850:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197854:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197859:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197863:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197868:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197874:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197879:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197884:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197889:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197895:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197901:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197907:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197912:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197917:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197923:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197928:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197933:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197938:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197944:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197950:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197955:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197962:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197967:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197972:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197977:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197983:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.197991:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.198010:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.198016:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199375:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199390:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199395:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199403:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199408:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199414:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199434:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199439:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199445:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199450:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199455:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.199461:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.209799:0:6613:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_001: service thread [ffff91d800584000:6613] 1 exiting: rc = 0 00000100:00100000:1.0:1782480947.210324:0:6612:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_000: service thread [ffff91d800585400:6612] 0 exiting: rc = 1 00000100:00100000:3.0:1782480947.212341:0:6614:0:(service.c:3182:ptlrpc_main()) ll_ost_io00_002: service thread [ffff91d800584200:6614] 2 exiting: rc = 0 00000100:00100000:2.0:1782480947.212678:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212687:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212692:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212697:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212702:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212708:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212714:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212719:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212723:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212729:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212734:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212740:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212745:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212751:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212757:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212762:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212768:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212773:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212782:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212788:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212793:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212799:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212818:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212825:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212831:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212836:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212841:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212846:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212866:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212872:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212877:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212882:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212888:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212893:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212898:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212905:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212910:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212915:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212921:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212927:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212932:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212938:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212944:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212949:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212954:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212960:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212978:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212985:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212990:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.212995:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213001:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213006:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213011:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213017:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213513:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213520:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213527:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213533:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213538:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213545:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213551:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213557:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213564:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.213579:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227769:0:6616:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff91d800584a00:6616] 1 exiting: rc = 0 00000100:00100000:1.0:1782480947.227864:0:6615:0:(service.c:3182:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff91d800585a00:6615] 0 exiting: rc = 1 00000100:00100000:2.0:1782480947.227914:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227923:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227929:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227935:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227940:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227946:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227952:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227957:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227962:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227967:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227973:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227978:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227983:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227989:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227994:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.227999:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.228005:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.228010:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.228016:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231013:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231439:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231447:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231452:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231457:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231462:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231466:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231472:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231477:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231481:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231487:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231492:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231498:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231503:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231523:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231528:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231533:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231538:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231543:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231548:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231553:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231559:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231564:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231569:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231574:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231579:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231583:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231588:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231594:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231599:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231603:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231608:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231613:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231618:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231623:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231628:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231633:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231638:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231643:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231648:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231653:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231681:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231688:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231693:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.231699:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1782480947.240176:0:6618:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_001: service thread [ffff91d7c2df7400:6618] 1 exiting: rc = 0 00000100:00100000:1.0:1782480947.240532:0:6617:0:(service.c:3182:ptlrpc_main()) ll_ost_out00_000: service thread [ffff91d7c2df7200:6617] 0 exiting: rc = 1 00000100:00100000:2.0:1782480947.243461:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243476:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243483:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243490:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243530:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243536:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243544:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243551:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243556:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243562:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243569:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243574:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243582:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243588:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243595:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243602:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243623:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243632:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243639:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243646:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243652:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243671:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243678:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243684:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243693:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243699:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243706:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243712:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243733:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243741:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243747:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243754:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243760:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243767:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243774:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243782:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243793:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243799:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243808:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243822:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243857:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243867:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243874:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243881:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243888:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243899:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243906:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243912:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243919:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243924:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243930:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243936:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243959:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243967:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243973:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243978:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243984:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243990:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.243997:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.244003:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.244011:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.244017:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.244150:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1782480947.244160:0:13158:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:2.0:1782480947.279586:0:13158:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1782480967.867641:0:13776:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1782480977.449187:0:14189:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782480977.449193:0:14189:0:(obd_mount.c:917:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1782480977.449306:0:14189:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91d7fe76b000 00000020:01000004:2.0:1782480977.449321:0:14189:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:2.0:1782480977.449328:0:14189:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782480977.449342:0:14189:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff91d7ef04b380) 00000020:00000080:2.0:1782480977.449355:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1782480977.488111:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:1.0:1782480977.492361:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:1.0:1782480977.492887:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 512: rc = 0 00100000:10000000:1.0:1782480977.493029:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:1.0:1782480977.493071:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 512: rc = 0 00100000:10000000:1.0:1782480977.493135:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 512: rc = 0 00100000:10000000:1.0:1782480977.493195:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 512: rc = 0 00100000:10000000:1.0:1782480977.493253:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 512: rc = 0 00100000:10000000:1.0:1782480977.493310:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 512: rc = 0 00100000:10000000:1.0:1782480977.493576:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 514: rc = 0 00100000:10000000:1.0:1782480977.494539:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 768: rc = 0 00100000:10000000:1.0:1782480977.495959:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 768: rc = 0 00100000:10000000:0.0:1782480977.502143:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1782480977.502476:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 655: rc = 0 00100000:10000000:0.0:1782480977.502759:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 655: rc = 0 00100000:10000000:0.0:1782480977.503211:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1782480977.503471:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1782480977.503958:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 655: rc = 0 00100000:10000000:0.0:1782480977.504276:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1782480977.504525:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1782480977.504971:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 655: rc = 0 00100000:10000000:0.0:1782480977.505352:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 655: rc = 0 00100000:10000000:0.0:1782480977.507919:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 655: rc = 0 00100000:10000000:0.0:1782480977.508166:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 655: rc = 0 00100000:10000000:0.0:1782480977.508875:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 671: rc = 0 00100000:10000000:0.0:1782480977.509097:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 671: rc = 0 00100000:10000000:0.0:1782480977.509322:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 671: rc = 0 00100000:10000000:0.0:1782480977.509896:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 671: rc = 0 00100000:10000000:0.0:1782480977.510130:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 671: rc = 0 00100000:10000000:0.0:1782480977.510370:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 671: rc = 0 00100000:10000000:0.0:1782480977.510958:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 671: rc = 0 00100000:10000000:0.0:1782480977.511189:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 671: rc = 0 00100000:10000000:0.0:1782480977.511923:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 671: rc = 0 00100000:10000000:0.0:1782480977.512205:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 671: rc = 0 00100000:10000000:0.0:1782480977.512543:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 671: rc = 0 00100000:10000000:0.0:1782480977.512964:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 671: rc = 0 00100000:10000000:0.0:1782480977.513246:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 671: rc = 0 00100000:10000000:0.0:1782480977.513564:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 671: rc = 0 00100000:10000000:0.0:1782480977.514112:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 671: rc = 0 00100000:10000000:0.0:1782480977.514369:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 671: rc = 0 00100000:10000000:0.0:1782480977.515096:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 671: rc = 0 00100000:10000000:0.0:1782480977.515343:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 671: rc = 0 00100000:10000000:0.0:1782480977.516225:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 671: rc = 0 00100000:10000000:0.0:1782480977.516533:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 671: rc = 0 00100000:10000000:0.0:1782480977.517097:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 671: rc = 0 00100000:10000000:0.0:1782480977.517349:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 671: rc = 0 00100000:10000000:0.0:1782480977.517630:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 671: rc = 0 00100000:10000000:0.0:1782480977.518299:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 671: rc = 0 00100000:10000000:0.0:1782480977.518569:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 671: rc = 0 00100000:10000000:0.0:1782480977.518878:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 671: rc = 0 00100000:10000000:0.0:1782480977.519141:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 671: rc = 0 00100000:10000000:0.0:1782480977.519375:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 671: rc = 0 00100000:10000000:0.0:1782480977.519610:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 671: rc = 0 00100000:10000000:0.0:1782480977.520802:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 671: rc = 0 00100000:10000000:0.0:1782480977.521061:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 671: rc = 0 00100000:10000000:0.0:1782480977.521291:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 671: rc = 0 00100000:10000000:2.0:1782480977.522141:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 669: rc = 0 00100000:10000000:2.0:1782480977.522886:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1782480977.523047:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 769: rc = 0 00100000:10000000:2.0:1782480977.523235:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1782480977.523298:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 769: rc = 0 00100000:10000000:2.0:1782480977.523565:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1782480977.523880:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 769: rc = 0 00100000:10000000:2.0:1782480977.524521:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1782480977.524590:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 428: rc = 0 00100000:10000000:2.0:1782480977.524959:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1782480977.525024:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 428: rc = 0 00100000:10000000:2.0:1782480977.525221:0:14189:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1782480977.525290:0:14189:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 428: rc = 0 00000020:00000080:2.0:1782480977.526926:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1782480977.526937:0:14189:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782480977.526949:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf60cb 00000020:01000004:2.0:1782480977.526958:0:14189:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1782480977.526963:0:14189:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1782480977.526969:0:14189:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d7fe76b000 from MGS 00000020:01000004:2.0:1782480977.526974:0:14189:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1782480977.526986:0:14189:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff91d7ef04cd40) 00000020:00000080:2.0:1782480977.526999:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1782480977.527056:0:14189:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d7fe76b000 from MGS, refs=2 00080000:01000000:2.0:1782480977.527062:0:14189:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782480977.527067:0:14189:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf60d9 00000100:00100000:2.0:1782480977.527189:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1782480977.527316:0:14189:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1782480977.527322:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1782480977.536564:0:14189:0:(service.c:3461:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1782480977.536582:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1782480977.539521:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782480977.540950:0:14189:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1782480977.540958:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1782480977.542111:0:14189:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1782480977.542121:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1782480977.542459:0:14189:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1782480977.542466:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:0.0:1782480977.549305:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480977.549312:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480977.549315:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480977.549958:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480977.549961:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480977.549963:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480977.550972:0:14189:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:0.0:1782480977.557762:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1782480977.593208:0:14189:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1782480977.593229:0:14189:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1782480977.593233:0:14189:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:3.0:1782480977.597877:0:14198:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:0.0:1782480977.598259:0:14189:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:0.0:1782480977.598370:0:14189:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782480977.599293:0:14189:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1782480977.600471:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480977.600698:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1782480977.600704:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1782480977.608924:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1782480977.608937:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1782480977.611078:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1782480977.611091:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:0.0:1782480977.612547:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:0.0:1782480977.612581:0:14189:0:(obd_mount.c:402:lustre_start_mgc()) Start MGC 'MGC192.168.201.158@tcp' 00000020:01000004:0.0:1782480977.612583:0:14189:0:(obd_mount.c:411:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:0.0:1782480977.612622:0:14189:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MGC192.168.201.158@tcp (typ=mgc) 00000020:00000080:0.0:1782480977.612634:0:14189:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.201.158@tcp (ffff91d7ff0c19c0) 00000020:00000080:0.0:1782480977.612681:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:0.0:1782480977.612762:0:14189:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d7fe76a800@MGC192.168.201.158@tcp: add connection 192.168.201.158@tcp at head 00010000:00010000:0.0:1782480977.612908:0:14189:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.201.158@tcp-0 is initialized 00000040:01000000:0.0:1782480977.612914:0:14189:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 1 is initialized 00000100:00080000:2.0:1782480977.615380:0:14203:0:(pinger.c:468:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1782480977.619498:0:14204:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1782480977.620024:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.201.158@tcp (uuid 4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc) 00000020:00000080:0.0:1782480977.620053:0:14189:0:(genops.c:1406:class_connect()) connect: client 4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc, cookie 0x4776e02a9acf60e7 00000100:00080000:0.0:1782480977.620067:0:14189:0:(import.c:512:import_select_connection()) MGC192.168.201.158@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1782480977.620074:0:14189:0:(import.c:626:import_select_connection()) MGC192.168.201.158@tcp: import ffff91d7fe76a800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1782480977.620108:0:14189:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7ff0b1500 x1869066388203136/t0(0) o250->MGC192.168.201.158@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782480977.620159:0:14189:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import 4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc->MGS 00000020:01000004:0.0:1782480977.620186:0:14189:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1782480977.620209:0:14189:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1782480977.620224:0:14189:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff91d7ff0c0000) 00000020:00000080:0.0:1782480977.620242:0:14189:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:2.0:1782480977.620857:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3309:1869066388203136:0@lo:250:mount.lustre.0 00000100:00100000:2.0:1782480977.620940:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480977.621021:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388203136 00000100:00100000:2.0:1782480977.621029:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388203136 00000100:00100000:2.0:1782480977.621061:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480977.621069:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1869066388203136:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1782480977.621093:0:14200:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc@0@lo t0 exp 0000000000000000 cur 508 last 0 00000020:00000080:2.0:1782480977.621118:0:14200:0:(genops.c:1406:class_connect()) connect: client 4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc, cookie 0x4776e02a9acf60f5 00000100:00080000:2.0:1782480977.621239:0:14200:0:(import.c:65:import_set_state_nolock()) ffff91d7c9b68000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782480977.621287:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+5:3309:x1869066388203136:12345-0@lo:250:mount.lustre.0 Request processed in 218us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480977.621295:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480977.621339:0:3309:0:(client.c:3111:ptlrpc_free_committed()) MGC192.168.201.158@tcp: committing for last_committed 0 gen 1 00000100:00080000:2.0:1782480977.621348:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) MGC192.168.201.158@tcp: connect to target with instance 0 00000100:00080000:2.0:1782480977.621355:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) MGC192.168.201.158@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:2.0:1782480977.621359:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:2.0:1782480977.621362:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7fe76a800 MGS: changing import state from CONNECTING to FULL 10000000:01000000:2.0:1782480977.621363:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:2.0:1782480977.621370:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:2.0:1782480977.621375:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3309:1869066388203136:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1782480977.650532:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480977.651103:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1782480977.651110:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1782480977.652255:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1782480977.652275:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:0.0:1782480977.652904:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:0.0:1782480977.652913:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:2.0:1782480977.654496:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480977.654953:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:2.0:1782480977.654959:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1782480977.657566:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1782480977.657580:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:2.0:1782480977.716075:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480977.716260:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:2.0:1782480977.716267:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:2.0:1782480977.717804:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:2.0:1782480977.717817:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:2.0:1782480977.718418:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480977.718815:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782480977.718821:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:2.0:1782480977.719182:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782480977.719188:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:2.0:1782480977.720089:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480977.720346:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782480977.720351:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:2.0:1782480977.721087:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782480977.721094:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:2.0:1782480977.721799:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480977.721952:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:2.0:1782480977.721957:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:2.0:1782480977.722550:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:2.0:1782480977.722557:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1782480977.746165:0:14189:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1782480977.746526:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1782480977.746534:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1782480977.748325:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782480977.748342:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1782480977.749371:0:14189:0:(service.c:3461:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1782480977.749383:0:14189:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:2.0:1782480977.750507:0:14189:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:2.0:1782480977.750530:0:14189:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:2.0:1782480977.750536:0:14189:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:2.0:1782480977.750726:0:14189:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:2.0:1782480977.750766:0:14189:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20005 00000020:01000004:2.0:1782480977.750770:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1782480977.750772:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782480977.750774:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480977.750775:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480977.750777:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480977.750778:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480977.750779:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782480977.750781:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782480977.750783:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480977.750784:0:14189:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782480977.750786:0:14189:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:2.0:1782480977.750789:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782480977.750790:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1782480977.750794:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480977.750795:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480977.750796:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480977.750798:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480977.750799:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1782480977.750800:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1782480977.750801:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480977.750802:0:14189:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1782480977.750827:0:14189:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1782480977.750847:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203264:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782480977.750926:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480977.750984:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c1377300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.751141:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388203264 00000100:00100000:0.0:1782480977.751149:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388203264 00000100:00100000:0.0:1782480977.751197:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480977.751207:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+5:14189:x1869066388203264:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782480977.751260:0:14202:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782480977.751264:0:14202:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1782480977.751267:0:14202:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1782480977.751908:0:14222:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1782480977.752266:0:14202:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:2.0:1782480977.753806:0:14223:0:(mgs_llog.c:341:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:2.0:1782480977.753813:0:14223:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:2.0:1782480977.753817:0:14223:0:(mgs_llog.c:325:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:2.0:1782480977.753849:0:14223:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1782480977.755152:0:14202:0:(mgs_llog.c:683:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1782480977.755165:0:14202:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:2.0:1782480977.771295:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+5:14189:x1869066388203264:12345-0@lo:253:mount.lustre.0 Request processed in 20079us (20357us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480977.771310:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480977.771390:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fc380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203264:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782480977.771406:0:14189:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782480977.771409:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782480977.771411:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480977.771413:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480977.771414:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480977.771416:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480977.771417:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480977.771418:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480977.771420:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480977.771421:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480977.771422:0:14189:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782480977.771558:0:14189:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d7fe76b000 from lustre-MDT0000 10000000:01000000:3.0:1782480977.771895:0:14189:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1782480977.771899:0:14189:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782480977.771904:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff91d7ff0c19c0 10000000:01000000:3.0:1782480977.771909:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480977.771918:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-sptlrpc-ffff91d7ff0c19c0 from 1 10000000:01000000:3.0:1782480977.771921:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1782480977.771963:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.772027:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.772037:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480977.772070:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203392:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782480977.772112:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480977.772174:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c1377300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480977.772279:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388203392 00000100:00100000:2.0:1782480977.772285:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388203392 00000100:00100000:2.0:1782480977.772357:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782480977.772367:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+5:14189:x1869066388203392:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782480977.772383:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480977.772401:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2d000/0x4776e02a9acf6103 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf60fc expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480977.772438:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2d000/0x4776e02a9acf6103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf60fc expref: 6 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480977.772447:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2d000/0x4776e02a9acf6103 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf60fc expref: 6 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480977.772466:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d000, rc 0) 00000100:00100000:2.0:1782480977.772510:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+6:14189:x1869066388203392:12345-0@lo:101:mount.lustre.0 Request processed in 144us (398us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480977.772516:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480977.772575:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203392:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480977.772597:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6103 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.772606:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf6103 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480977.772680:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203520:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480977.772710:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480977.773037:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c1377300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.773312:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388203520 00000100:00100000:0.0:1782480977.773317:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388203520 00000100:00100000:0.0:1782480977.773344:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782480977.773351:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+6:14189:x1869066388203520:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480977.773752:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+6:14189:x1869066388203520:12345-0@lo:501:mount.lustre.0 Request processed in 401us (1048us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782480977.773759:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782480977.773839:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203520:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782480977.773867:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1782480977.773887:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6103 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.773896:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6103 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480977.773904:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d7fe76b000 10000000:01000000:3.0:1782480977.773908:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782480977.773912:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff91d7fe76b000 10000000:01000000:3.0:1782480977.773915:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1782480977.773917:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-barrier-ffff91d7fe76b000 from 1 10000000:01000000:3.0:1782480977.773925:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1782480977.773943:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779b800/0x4776e02a9acf610a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.773951:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779b800/0x4776e02a9acf610a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.773959:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779b800/0x4776e02a9acf610a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480977.774095:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203648:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782480977.774121:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480977.774147:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c1377300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.774199:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388203648 00000100:00100000:0.0:1782480977.774203:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388203648 00000100:00100000:0.0:1782480977.774224:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782480977.774230:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+6:14189:x1869066388203648:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782480977.774239:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480977.774250:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297aa00/0x4776e02a9acf6111 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf610a expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480977.774266:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297aa00/0x4776e02a9acf6111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf610a expref: 7 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480977.774275:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297aa00/0x4776e02a9acf6111 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf610a expref: 7 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480977.774283:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297aa00, rc 0) 00000100:00100000:0.0:1782480977.774313:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+7:14189:x1869066388203648:12345-0@lo:101:mount.lustre.0 Request processed in 83us (191us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480977.774319:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782480977.774435:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203648:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480977.774447:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779b800/0x4776e02a9acf610a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6111 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.774455:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779b800/0x4776e02a9acf610a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf6111 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480977.774467:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1782480977.774479:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779b800/0x4776e02a9acf610a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6111 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.774494:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779b800/0x4776e02a9acf610a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6111 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782480977.774499:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1782480977.774503:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782480977.774513:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff91d7fe76b000 10000000:01000000:3.0:1782480977.774515:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1782480977.774518:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1782480977.774520:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1782480977.774532:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779ac00/0x4776e02a9acf6118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.774538:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779ac00/0x4776e02a9acf6118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.774545:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779ac00/0x4776e02a9acf6118 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480977.774556:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203776:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782480977.774760:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480977.774771:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c1377300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.774831:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388203776 00000100:00100000:0.0:1782480977.774835:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388203776 00000100:00100000:0.0:1782480977.774853:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1782480977.774859:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+7:14189:x1869066388203776:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782480977.774867:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480977.774874:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297ac00/0x4776e02a9acf611f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6118 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480977.774888:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297ac00/0x4776e02a9acf611f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6118 expref: 8 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480977.774896:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297ac00/0x4776e02a9acf611f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6118 expref: 8 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480977.774913:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297ac00, rc 0) 00000100:00100000:0.0:1782480977.774944:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+8:14189:x1869066388203776:12345-0@lo:101:mount.lustre.0 Request processed in 85us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480977.774950:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782480977.775006:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203776:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480977.775015:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779ac00/0x4776e02a9acf6118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf611f expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.775023:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779ac00/0x4776e02a9acf6118 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf611f expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480977.775058:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480977.775078:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480977.775102:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c1377300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.775139:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388203904 00000100:00100000:0.0:1782480977.775142:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388203904 00000100:00100000:0.0:1782480977.775157:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782480977.775162:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+8:14189:x1869066388203904:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480977.775917:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+9:14189:x1869066388203904:12345-0@lo:501:mount.lustre.0 Request processed in 751us (835us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480977.775925:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782480977.776117:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388203904:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480977.776154:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388204032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480977.779157:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480977.779289:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c1377300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480977.779548:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388204032 00000100:00100000:2.0:1782480977.779556:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388204032 00000100:00100000:2.0:1782480977.779874:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1782480977.779884:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+9:14189:x1869066388204032:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782480977.780348:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+9:14189:x1869066388204032:12345-0@lo:503:mount.lustre.0 Request processed in 464us (1196us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480977.780356:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782480977.780463:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388204032:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480977.781222:0:14224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14224:1869066388204160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480977.781272:0:14224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480977.782285:0:14224:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c1377f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.782340:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388204160 00000100:00100000:0.0:1782480977.782348:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388204160 00000100:00100000:0.0:1782480977.782394:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782480977.782403:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+9:14224:x1869066388204160:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480977.784377:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+9:14224:x1869066388204160:12345-0@lo:502:llog_process_th.0 Request processed in 1966us (3096us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480977.784395:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1782480977.784978:0:14224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14224:1869066388204160:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1782480977.785017:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480977.785030:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480977.785032:0:14224:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782480977.785037:0:14224:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1782480977.785041:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782480977.785056:0:14224:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff91d7ff0c3380) 00000020:00000080:0.0:1782480977.785075:0:14224:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1782480977.785081:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1782480977.785167:0:14224:0:(osd_handler.c:1569:osd_obd_connect()) connect #2 00000020:00000080:0.0:1782480977.785174:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf612d 00000020:00000080:0.0:1782480977.785867:0:14224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1782480977.785872:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782480977.785876:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480977.785878:0:14224:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1782480977.785880:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782480977.785884:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782480977.785885:0:14224:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1782480977.785888:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782480977.785894:0:14224:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff91d7ff0c4d40) 00000020:00000080:0.0:1782480977.785903:0:14224:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1782480977.785906:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1782480977.785908:0:14224:0:(obd_config.c:1514:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1782480977.785911:0:14224:0:(obd_config.c:1148:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1782480977.785916:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782480977.785953:0:14224:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d7fe76b000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1782480977.785975:0:14224:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff91d7ecfa99c0) 00000020:00000080:0.0:1782480977.785983:0:14224:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1782480977.786033:0:14224:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1782480977.786038:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4776e02a9acf6142 00000020:00000080:0.0:1782480977.787605:0:14224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1782480977.787619:0:14224:0:(mdd_device.c:1596:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1782480977.787627:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x4776e02a9acf6149 00080000:01000000:0.0:1782480977.787636:0:14224:0:(osd_handler.c:1569:osd_obd_connect()) connect #3 00000020:00000080:0.0:1782480977.787640:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf6150 00010000:00010000:1.0:1782480977.936277:0:14224:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:1.0:1782480977.936953:0:14224:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:1.0:1782480977.937148:0:14224:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:1.0:1782480977.938428:0:14224:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff91d7f4cc4d40) 00000020:00000080:1.0:1782480977.938456:0:14224:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:1.0:1782480977.938730:0:14224:0:(osd_handler.c:1569:osd_obd_connect()) connect #4 00000020:00000080:1.0:1782480977.938738:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf615e 00000020:00000080:3.0:1782480977.940815:0:14224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1782480977.957857:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x4776e02a9acf6165 00000020:00000080:1.0:1782480977.959908:0:14224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1782480977.959923:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480977.959929:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.959932:0:14224:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1782480977.959935:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480977.959942:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.959943:0:14224:0:(obd_config.c:1561:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1782480977.959948:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1782480977.959993:0:14224:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1782480977.960008:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480977.960010:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.960012:0:14224:0:(obd_config.c:1561:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1782480977.960014:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1782480977.960024:0:14224:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #9 00000020:01000000:1.0:1782480977.960025:0:14224:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782480977.960027:0:14224:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1782480977.960029:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1782480977.960031:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.960032:0:14224:0:(obd_config.c:1561:class_process_config()) marker 9 (0x6) lustre sys.timeout 00000020:01000000:1.0:1782480977.960034:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1782480977.960037:0:14224:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1782480977.960040:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.960041:0:14224:0:(obd_config.c:1561:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1782480977.960044:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1782480977.960049:0:14224:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:1.0:1782480977.960071:0:14224:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1782480977.960074:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1782480977.960088:0:14224:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff91d7f4cc0000) 00000020:00000080:1.0:1782480977.960103:0:14224:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1782480977.960107:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1782480977.960157:0:14224:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1782480977.960162:0:14224:0:(osd_handler.c:1569:osd_obd_connect()) connect #5 00000020:00000080:1.0:1782480977.960167:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf6173 00010000:00080000:1.0:1782480977.960193:0:14224:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d7c52a3800@lustre-OST0000-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1782480977.960402:0:14224:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1782480977.960879:0:14224:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1782480977.960923:0:14224:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1782480977.962852:0:14224:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480977.962941:0:14224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1782480977.963021:0:14224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1782480977.964868:0:14228:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782480977.964878:0:14228:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1782480977.966082:0:14224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1782480977.966100:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1782480977.966141:0:14224:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1782480977.966162:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4776e02a9acf617a 00000100:00080000:3.0:1782480977.966175:0:14224:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782480977.966182:0:14224:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d7c52a3800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:3.0:1782480977.966219:0:14224:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7efe73b80 x1869066388204288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1782480977.966292:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388204288:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1782480977.966352:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066388204288 offset 0 length 520: 4 00000100:00080000:3.0:1782480977.966414:0:14224:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1782480977.966472:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1782480977.966477:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480977.966479:0:14224:0:(obd_config.c:1561:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1782480977.966482:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:3.0:1782480977.966485:0:14224:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #14 00000020:01000000:3.0:1782480977.966487:0:14224:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782480977.966488:0:14224:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:3.0:1782480977.966490:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:3.0:1782480977.966503:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480977.966505:0:14224:0:(obd_config.c:1561:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:3.0:1782480977.966508:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1782480977.966513:0:14224:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:3.0:1782480977.966517:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1782480977.966518:0:14224:0:(obd_config.c:1561:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:3.0:1782480977.966521:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf005 00000020:00000080:3.0:1782480977.966525:0:14224:0:(obd_config.c:1485:class_process_config()) adding mapping from uuid 192.168.201.158@tcp to nid 0x20000c0a8c99e (192.168.201.158@tcp) 00000020:01000000:3.0:1782480977.966548:0:14224:0:(obd_config.c:1975:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:3.0:1782480977.966551:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1782480977.966563:0:14224:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff91d7ed21b380) 00000020:00000080:3.0:1782480977.966575:0:14224:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:3.0:1782480977.966580:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000004:00080000:3.0:1782480977.966686:0:14224:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:3.0:1782480977.966694:0:14224:0:(osd_handler.c:1569:osd_obd_connect()) connect #6 00000020:00000080:3.0:1782480977.966700:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x4776e02a9acf6188 00010000:00080000:3.0:1782480977.966740:0:14224:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d7c77ca000@lustre-OST0001-osc-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:3.0:1782480977.966952:0:14224:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:3.0:1782480977.967150:0:14224:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:3.0:1782480977.967176:0:14224:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:3.0:1782480977.970503:0:14224:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480977.970792:0:14224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:3.0:1782480977.970872:0:14224:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:1.0:1782480977.971831:0:14230:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782480977.971838:0:14230:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1782480977.972510:0:14224:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1782480977.972528:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1782480977.972573:0:14224:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1782480977.972594:0:14224:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4776e02a9acf618f 00000100:00080000:1.0:1782480977.972604:0:14224:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782480977.972610:0:14224:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d7c77ca000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:1.0:1782480977.972656:0:14224:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d6c1e75f80 x1869066388204416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782480977.972704:0:14224:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1782480977.972752:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480977.972757:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.972759:0:14224:0:(obd_config.c:1561:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1782480977.972761:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480977.972765:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.972766:0:14224:0:(obd_config.c:1561:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:1.0:1782480977.972769:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1782480977.972771:0:14224:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1782480977.972773:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480977.972776:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.972777:0:14224:0:(obd_config.c:1561:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:1.0:1782480977.972779:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480977.972781:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.972782:0:14224:0:(obd_config.c:1561:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1782480977.972786:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1782480977.972817:0:14224:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14224:1869066388204544:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480977.972895:0:14224:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480977.972928:0:14224:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c246f000 going to sleep for 11 seconds 00000100:00100000:2.0:1782480977.973005:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388204416:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1782480977.973035:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066388204416 offset 0 length 520: 4 00000100:00100000:3.0:1782480977.973121:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388204544 00000100:00100000:3.0:1782480977.973127:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388204544 00000100:00100000:3.0:1782480977.973377:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782480977.973387:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+9:14224:x1869066388204544:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480977.973620:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+9:14224:x1869066388204544:12345-0@lo:502:llog_process_th.0 Request processed in 234us (723us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480977.973627:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782480977.973747:0:14224:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14224:1869066388204544:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480977.973776:0:14224:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480977.973780:0:14224:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.973782:0:14224:0:(obd_config.c:1561:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1782480977.973790:0:14224:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:1.0:1782480977.973852:0:14189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:1.0:1782480977.973872:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:1.0:1782480977.973889:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779ac00/0x4776e02a9acf6118 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf611f expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.973900:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779ac00/0x4776e02a9acf6118 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf611f expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480977.973907:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91d7fe76b000 from 1 10000000:01000000:1.0:1782480977.973910:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1782480977.973937:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.973944:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.973953:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480977.973968:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388204672:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782480977.973996:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480977.974547:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea0729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480977.975038:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388204672 00000100:00100000:2.0:1782480977.975046:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388204672 00000100:00100000:2.0:1782480977.975086:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1782480977.975094:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+9:14189:x1869066388204672:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782480977.975106:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480977.975122:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf619d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6196 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480977.975145:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf619d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6196 expref: 10 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480977.975166:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf619d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6196 expref: 10 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480977.975175:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d600, rc 0) 00000100:00100000:2.0:1782480977.975219:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+10:14189:x1869066388204672:12345-0@lo:101:mount.lustre.0 Request processed in 126us (1224us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480977.975225:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782480977.976547:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388204672:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782480977.976572:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.976594:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480977.977196:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388204800:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1782480977.977265:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480977.977306:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea0729c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782480977.977695:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388204800 00000100:00100000:2.0:1782480977.977703:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388204800 00000100:00100000:2.0:1782480977.977744:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1782480977.977753:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+10:14189:x1869066388204800:12345-0@lo:256:mount.lustre.0 20000000:01000000:2.0:1782480977.977774:0:14201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1782480977.977782:0:14201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1782480977.977866:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+10:14189:x1869066388204800:12345-0@lo:256:mount.lustre.0 Request processed in 114us (601us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480977.977874:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1782480977.977967:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388204800:0@lo:256:mount.lustre.0 10000000:01000000:1.0:1782480977.980026:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1782480977.980101:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.980117:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480977.980128:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7fe76b000 from 1 10000000:01000000:1.0:1782480977.980131:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480977.980177:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.980186:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.980198:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480977.980223:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388204928:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782480977.980290:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480977.980326:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea0729c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.982325:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388204928 00000100:00100000:0.0:1782480977.982340:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388204928 00000100:00100000:0.0:1782480977.982412:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782480977.982422:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+10:14189:x1869066388204928:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782480977.982437:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480977.982456:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf61ab lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf61a4 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480977.982503:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf61ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf61a4 expref: 11 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480977.982514:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf61ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf61a4 expref: 11 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480977.982522:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a400, rc 0) 00000100:00100000:0.0:1782480977.982585:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14189:x1869066388204928:12345-0@lo:101:mount.lustre.0 Request processed in 165us (2295us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480977.982592:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1782480977.982766:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388204928:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782480977.982832:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.982842:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480977.982915:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388205056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480977.982949:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480977.982975:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea0729c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.983043:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388205056 00000100:00100000:0.0:1782480977.983047:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388205056 00000100:00100000:0.0:1782480977.983078:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1782480977.983086:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14189:x1869066388205056:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480977.983461:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14189:x1869066388205056:12345-0@lo:501:mount.lustre.0 Request processed in 375us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480977.983468:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782480977.983549:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388205056:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480977.983581:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388205184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782480977.983618:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480977.983649:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea0729c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.983727:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388205184 00000100:00100000:0.0:1782480977.983732:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388205184 00000100:00100000:0.0:1782480977.983763:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1782480977.983770:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14189:x1869066388205184:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782480977.983906:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14189:x1869066388205184:12345-0@lo:503:mount.lustre.0 Request processed in 135us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480977.983913:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782480977.983986:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388205184:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782480977.984331:0:14232:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14232:1869066388205312:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480977.984361:0:14232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480977.984389:0:14232:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.984434:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388205312 00000100:00100000:0.0:1782480977.984439:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388205312 00000100:00100000:0.0:1782480977.984472:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782480977.984478:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14232:x1869066388205312:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480977.984636:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14232:x1869066388205312:12345-0@lo:502:llog_process_th.0 Request processed in 157us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480977.984653:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1782480977.984765:0:14232:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14232:1869066388205312:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1782480977.984786:0:14232:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480977.984796:0:14232:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.984799:0:14232:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782480977.984805:0:14232:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d7fe76b000 00000020:00000080:1.0:1782480977.984808:0:14232:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782480977.984815:0:14232:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480977.984818:0:14232:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.984819:0:14232:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782480977.984827:0:14232:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480977.984830:0:14232:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.984831:0:14232:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782480977.984835:0:14232:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d7fe76b000 00000020:00000080:1.0:1782480977.984837:0:14232:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782480977.984888:0:14232:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782480977.984891:0:14232:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.984893:0:14232:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782480977.984895:0:14232:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782480977.984898:0:14232:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782480977.984899:0:14232:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782480977.984903:0:14232:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d7fe76b000 00000020:00000080:1.0:1782480977.984904:0:14232:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1782480977.984936:0:14232:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14232:1869066388205440:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480977.984966:0:14232:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480977.984977:0:14232:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072d80 going to sleep for 11 seconds 00000100:00100000:0.0:1782480977.985028:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388205440 00000100:00100000:0.0:1782480977.985032:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388205440 00000100:00100000:0.0:1782480977.985062:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1782480977.985069:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14232:x1869066388205440:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1782480977.985171:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14232:x1869066388205440:12345-0@lo:502:llog_process_th.0 Request processed in 102us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480977.985176:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1782480977.986760:0:14232:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14232:1869066388205440:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1782480977.986797:0:14232:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480977.986805:0:14232:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480977.986807:0:14232:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782480977.986812:0:14232:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1782480977.987010:0:14189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1782480977.987032:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782480977.987046:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.987058:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480977.987105:0:14189:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782480977.987109:0:14189:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d7fe76b000 10000000:01000000:1.0:1782480977.987112:0:14189:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d7fe76b000 10000000:01000000:1.0:1782480977.987116:0:14189:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782480977.987123:0:14189:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d7fe76b000 from 1 10000000:01000000:1.0:1782480977.987126:0:14189:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782480977.987162:0:14189:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fc00/0x4776e02a9acf61b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.987178:0:14189:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fc00/0x4776e02a9acf61b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.987188:0:14189:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fc00/0x4776e02a9acf61b2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480977.987211:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388205568:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782480977.987272:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480977.987307:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea0720c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480977.987781:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388205568 00000100:00100000:1.0:1782480977.987788:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388205568 00000100:00100000:1.0:1782480977.987867:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1782480977.987876:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14189:x1869066388205568:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782480977.987887:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782480977.987903:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7ef55f600/0x4776e02a9acf61b9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf61b2 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.987926:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7ef55f600/0x4776e02a9acf61b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf61b2 expref: 12 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.987936:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7ef55f600/0x4776e02a9acf61b9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf61b2 expref: 12 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480977.987945:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7ef55f600, rc 0) 00000100:00100000:1.0:1782480977.987992:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14189:x1869066388205568:12345-0@lo:101:mount.lustre.0 Request processed in 117us (720us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480977.987999:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1782480977.988084:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e74700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388205568:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480977.988099:0:14189:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fc00/0x4776e02a9acf61b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61b9 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480977.988108:0:14189:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fc00/0x4776e02a9acf61b2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf61b9 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480977.988162:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388205696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480977.988191:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480977.994991:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7f4eeda80 going to sleep for 11 seconds 00000100:00100000:2.0:1782480978.010327:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388205696 00000100:00100000:2.0:1782480978.010344:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388205696 00000100:00100000:2.0:1782480978.010440:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1782480978.010450:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14189:x1869066388205696:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782480978.010808:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14189:x1869066388205696:12345-0@lo:501:mount.lustre.0 Request processed in 359us (22615us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480978.010823:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1782480978.015345:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388205696:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480978.015417:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388205824:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480978.015495:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480978.016339:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7f4eeda80 going to sleep for 11 seconds 00000100:00100000:1.0:1782480978.025783:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388205824 00000100:00100000:1.0:1782480978.025800:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388205824 00000100:00100000:1.0:1782480978.025860:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1782480978.025869:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14189:x1869066388205824:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782480978.026130:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14189:x1869066388205824:12345-0@lo:503:mount.lustre.0 Request processed in 261us (10633us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480978.026137:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1782480978.026268:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388205824:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782480978.027827:0:14237:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e74000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14237:1869066388205952:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1782480978.027894:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480978.027942:0:14237:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072540 going to sleep for 11 seconds 00000100:00100000:3.0:1782480978.028000:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388205952 00000100:00100000:3.0:1782480978.028006:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388205952 00000100:00100000:3.0:1782480978.028050:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782480978.028060:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed420050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14237:x1869066388205952:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480978.028312:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed420050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14237:x1869066388205952:12345-0@lo:502:llog_process_th.0 Request processed in 253us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480978.028320:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1782480978.028368:0:14237:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e74000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14237:1869066388205952:0@lo:502:llog_process_th.0 00000020:01000004:3.0:1782480978.028426:0:14237:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1782480978.028440:0:14237:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff91d7ed218000) 00000020:00000080:3.0:1782480978.028463:0:14237:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:3.0:1782480978.031033:0:14237:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d7fe76b000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782480978.031041:0:14237:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d7fe76b000 from lustre-MDT0000, refs=4 00000020:01000004:3.0:1782480978.031044:0:14237:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d7fe76b000 4 00010000:00080000:3.0:1782480978.031080:0:14237:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d7ff0b9000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.201.158@tcp at head 00010000:00010000:3.0:1782480978.032768:0:14237:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:3.0:1782480978.032880:0:14237:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:3.0:1782480978.032919:0:14237:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1782480978.032931:0:14237:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x4776e02a9acf61c7 00000100:00080000:3.0:1782480978.032942:0:14237:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1782480978.032948:0:14237:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91d7ff0b9000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:3.0:1782480978.032986:0:14237:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7efe73480 x1869066388206080/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:3.0:1782480978.033020:0:14237:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782480978.033687:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869066388206080:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782480978.033760:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480978.037058:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388206080 00000100:00100000:0.0:1782480978.037075:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388206080 00000100:00100000:0.0:1782480978.037123:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480978.037131:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1869066388206080:12345-0@lo:38:llog_process_th.0 00000100:00100000:0.0:1782480978.037243:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1869066388206080:12345-0@lo:38:llog_process_th.0 Request processed in 110us (3482us total) trans 0 rc -11/-11 00000100:00100000:0.0:1782480978.037250:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480978.040438:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782480978.040453:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7ff0b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782480978.040461:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1782480978.040466:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869066388206080:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1782480978.041568:0:14237:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14237:1869066388206208:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480978.041690:0:14237:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480978.041727:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388206208 00000100:00100000:3.0:1782480978.041734:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388206208 00000100:00100000:3.0:1782480978.041772:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782480978.041781:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14237:x1869066388206208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1782480978.042003:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14237:x1869066388206208:12345-0@lo:502:llog_process_th.0 Request processed in 222us (312us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480978.042011:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1782480978.042121:0:14237:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1fcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480978.042138:0:14237:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14237:1869066388206208:0@lo:502:llog_process_th.0 00000040:00080000:3.0:1782480978.042161:0:14237:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1782480978.042218:0:14189:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1782480978.042243:0:14189:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1782480978.042259:0:14189:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fc00/0x4776e02a9acf61b2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61b9 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.042270:0:14189:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fc00/0x4776e02a9acf61b2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61b9 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1782480978.042314:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1782480978.042317:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480978.042318:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480978.042320:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480978.042321:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480978.042322:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480978.042324:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480978.042325:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480978.042327:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480978.042329:0:14189:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782480978.042333:0:14189:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1782480978.042335:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782480978.042337:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480978.042338:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480978.042339:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480978.042340:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480978.042341:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480978.042342:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480978.042343:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480978.042344:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480978.042345:0:14189:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1782480978.042357:0:14189:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1782480978.042367:0:14189:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388206336:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782480978.042395:0:14189:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480978.042405:0:14189:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480978.043146:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388206336 00000100:00100000:1.0:1782480978.043153:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388206336 00000100:00100000:1.0:1782480978.043198:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1782480978.043206:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14189:x1869066388206336:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782480978.043231:0:14200:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1782480978.043245:0:14200:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782480978.151709:0:14200:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782480978.151728:0:14200:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1782480978.151909:0:14222:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1782480978.151914:0:14222:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1782480978.151945:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.151980:0:14222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf619d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6196 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.151989:0:14222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.152028:0:14222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf619d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf6196 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.152043:0:14222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf619d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf6196 expref: 12 pid: 14201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480978.152057:0:14222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14222:1869066388206464:0@lo:104: 00000100:00100000:3.0:1782480978.152120:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480978.152168:0:14222:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f600 going to sleep for 11 seconds 00000100:00100000:3.0:1782480978.152242:0:14190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388206464 00000100:00100000:3.0:1782480978.152251:0:14190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388206464 00000100:00100000:3.0:1782480978.152305:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480978.152313:0:14190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+3:14222:x1869066388206464:12345-0@lo:104: 00010000:00010000:3.0:1782480978.152325:0:14190:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.152374:0:14190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782480978.152381:0:14190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+3:14222:x1869066388206464:12345-0@lo:104: Request processed in 68us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480978.152387:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:0.0:1782480978.152399:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480978.152406:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.152413:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55fe00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480978.152416:0:14196:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.152425:0:14196:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480978.152436:0:14222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73800 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14222:1869066388206464:0@lo:104: 10000000:00010000:0.0:1782480978.152438:0:14196:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480978.152444:0:14196:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782480978.152452:0:14222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.152469:0:14196:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.152474:0:14196:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480978.152497:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.152505:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fe00/0x4776e02a9acf6196 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf619d expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480978.152512:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3312:1869066388206592:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480978.152521:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480978.152522:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480978.152524:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782480978.152538:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480978.152957:0:14192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388206592 00000100:00100000:0.0:1782480978.152967:0:14192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388206592 00010000:00010000:0.0:1782480978.152986:0:14192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf619d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf6196 expref: 13 pid: 14201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480978.153015:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782480978.153022:0:14192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+13:3312:x1869066388206592:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480978.153032:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480978.153035:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf619d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf6196 expref: 13 pid: 14201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153045:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf619d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf6196 expref: 13 pid: 14201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153064:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf619d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf6196 expref: 13 pid: 14201 timeout: 608 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153074:0:14192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153080:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1782480978.153287:0:14192:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001373521s 00010000:00010000:0.0:1782480978.153297:0:14192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153308:0:14192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153315:0:14192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153322:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153327:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779be00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480978.153332:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153339:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153357:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.153371:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782480978.153380:0:14222:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480978.153388:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480978.153394:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf61ce lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480978.153407:0:14192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:3312:x1869066388206592:12345-0@lo:103:ldlm_bl.0 Request processed in 385us (867us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480978.153414:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782480978.153574:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3312:1869066388206592:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1782480978.170220:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14189:x1869066388206336:12345-0@lo:253:mount.lustre.0 Request processed in 127002us (127811us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480978.170237:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1782480978.170384:0:14189:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14189:1869066388206336:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782480978.170406:0:14189:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1782480978.170410:0:14189:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782480978.170412:0:14189:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1782480978.170413:0:14189:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480978.170415:0:14189:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480978.170416:0:14189:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480978.170418:0:14189:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480978.170419:0:14189:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1782480978.170420:0:14189:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1782480978.170422:0:14189:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480978.170424:0:14189:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1782480978.170438:0:14189:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782480978.181469:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480978.181682:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480978.181968:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480978.182128:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480978.182398:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480978.182557:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480978.187075:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480978.187270:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480978.189898:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480978.190243:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480978.192870:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480978.193112:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:3.0:1782480978.242949:0:14189:0:(update_trans.c:1487:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:3.0:1782480978.243471:0:14189:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1782480978.243978:0:14247:0:(llog_osd.c:2237:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:3.0:1782480978.244053:0:14247:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782480978.250412:0:14247:0:(llog.c:857:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1782480978.250501:0:14247:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1782480978.250506:0:14247:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:00080000:0.0:1782480978.252589:0:14246:0:(update_trans.c:1530:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:0.0:1782480978.252595:0:14246:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1782480978.252822:0:14189:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:1.0:1782480978.252951:0:14189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:1.0:1782480978.254366:0:14189:0:(mdd_device.c:553:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:1.0:1782480978.254383:0:14189:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:1.0:1782480978.258933:0:14189:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782480978.263125:0:14189:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1782480978.264066:0:14189:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1782480978.264374:0:14189:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1782480978.277967:0:14189:0:(osd_index.c:2102:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1782480978.284850:0:14189:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:3.0:1782480978.329759:0:14189:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:3.0:1782480978.329796:0:14189:0:(mdd_device.c:2302:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb05741c6f988 00100000:10000000:3.0:1782480978.329805:0:14189:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1782480978.335598:0:14189:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782480978.335618:0:14189:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782480978.335640:0:14189:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1782480978.335685:0:14189:0:(super25.c:187:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:0.0:1782480978.602171:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782480978.640344:0:14204:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782480978.640359:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91d7fe76b000 from 6 10000000:01000000:3.0:1782480978.640363:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782480978.640416:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.640429:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.640441:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480978.640467:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388206720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782480978.640562:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480978.640643:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f780 going to sleep for 11 seconds 00000100:00100000:3.0:1782480978.640693:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388206720 00000100:00100000:3.0:1782480978.640700:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388206720 00000100:00100000:3.0:1782480978.640761:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782480978.640772:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14204:x1869066388206720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480978.640787:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480978.640802:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf61dc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf61d5 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.640832:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf61dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf61d5 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.640844:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf61dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf61d5 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.640853:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a400, rc 0) 00000100:00100000:3.0:1782480978.640892:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14204:x1869066388206720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 123us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480978.640907:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1782480978.640956:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388206720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480978.640972:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480978.640982:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480978.641032:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388206848:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782480978.641063:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480978.641450:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c8d1f780 going to sleep for 11 seconds 00000100:00100000:0.0:1782480978.641458:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388206848 00000100:00100000:0.0:1782480978.641465:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388206848 00000100:00100000:0.0:1782480978.641498:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782480978.641506:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14204:x1869066388206848:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782480978.641523:0:14200:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782480978.641541:0:14200:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782480978.641545:0:14200:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1782480978.641649:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14204:x1869066388206848:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480978.641681:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782480978.641727:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388206848:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1782480978.641771:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1782480978.641779:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480978.641788:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480979.103446:0:14240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782480979.615153:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782480980.128668:0:14240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782480980.643714:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480981.668730:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480982.687880:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1782480983.457472:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782480983.457489:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782480983.457492:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1782480983.457494:0:36:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1782480983.457497:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:1.0:1782480983.457500:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1782480983.457504:0:36:0:(import.c:65:import_set_state_nolock()) ffff91d7ff0b9000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1782480983.457518:0:36:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff91d7ff0b9000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:1.0:1782480983.457552:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d6c1e75500 x1869066388207104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782480983.457593:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388206976:0@lo:400:kworker.0 00000100:00100000:1.0:1782480983.457717:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480983.457787:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869066388207104:0@lo:38:kworker.0 00000100:00100000:1.0:1782480983.457818:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480983.457853:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388206976 00000100:00100000:1.0:1782480983.457860:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388206976 00000100:00100000:1.0:1782480983.457968:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782480983.457976:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:3313:x1869066388206976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782480983.458060:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:3313:x1869066388206976:12345-0@lo:400:kworker.0 Request processed in 84us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1782480983.458067:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1782480983.458155:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e74e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388206976:0@lo:400:kworker.0 00000100:00100000:0.0:1782480983.463024:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388207104 00000100:00100000:0.0:1782480983.463055:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388207104 00000100:00100000:0.0:1782480983.463139:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480983.463149:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1869066388207104:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1782480983.463205:0:14208:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 514 last 0 00000020:00000080:0.0:1782480983.463276:0:14208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x4776e02a9acf61e3 00000004:00100000:0.0:1782480983.463304:0:14208:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1782480983.463501:0:14208:0:(import.c:65:import_set_state_nolock()) ffff91d7c7f71000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782480983.463636:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e76d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1869066388207104:12345-0@lo:38:kworker.0 Request processed in 487us (5815us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480983.463643:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1782480983.464036:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d6c1e75500 x1869066388207104/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782480993 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1782480983.464070:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1782480983.464077:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1782480983.464082:0:3309:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1782480983.464085:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7ff0b9000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1782480983.464091:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1869066388207104:0@lo:38:kworker.0 00010000:00010000:2.0:1782480983.716762:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782480984.193908:0:14490:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782480984.736343:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480985.759823:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480986.787654:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480987.550896:0:3309:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480977/real 1782480977] req@ffff91d6c1e75f80 x1869066388204416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480987 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480987.550932:0:3309:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d6c1e75f80 x1869066388204416/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480987 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480987.550944:0:3309:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480977/real 1782480977] req@ffff91d7efe73b80 x1869066388204288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480987 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480987.550955:0:3309:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d7efe73b80 x1869066388204288/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782480987 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1782480987.550974:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782480987.551055:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782480987.551060:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388204416:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1782480987.551066:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7c52a3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00100000:3.0:1782480987.551291:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:2.0:1782480987.551899:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782480987.551904:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1782480987.551907:0:36:0:(import.c:65:import_set_state_nolock()) ffff91d7c52a3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782480987.551914:0:36:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:2.0:1782480987.551920:0:36:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782480987.551927:0:36:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d7c52a3800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1782480987.551952:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7c30ff480 x1869066388207360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1782480987.551965:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1782480987.551967:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1782480987.551969:0:36:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1782480987.551971:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 508 00000100:00080000:2.0:1782480987.551974:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1782480987.551977:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d7c77ca000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:2.0:1782480987.551985:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7c30ff100 x1869066388207488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1782480987.552741:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388207616:0@lo:400:kworker.0 00000100:00100000:3.0:1782480987.552818:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480987.552876:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3311:1869066388207232:0@lo:400:kworker.0 00000100:00100000:3.0:1782480987.552950:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782480987.553087:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1782480987.553093:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388204288:0@lo:8:llog_process_th.0 00000100:00100000:0.0:1782480987.553120:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388207360:0@lo:8:kworker.0 00000400:00000100:0.0:1782480987.553147:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066388207360 offset 0 length 520: 4 00000100:00100000:0.0:1782480987.553162:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388207488:0@lo:8:kworker.0 00000400:00000100:0.0:1782480987.553179:0:3309:0:(lib-move.c:4262:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1869066388207488 offset 0 length 520: 4 00000100:00100000:2.0:1782480987.553563:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388207616 00000100:00100000:2.0:1782480987.553584:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388207616 00000100:00100000:2.0:1782480987.554083:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782480987.554094:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388207616:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480987.554171:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe71180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388207616:12345-0@lo:400:kworker.0 Request processed in 79us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480987.554179:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1782480987.554262:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d7c30fdc00 x1869066388207616/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480987.554277:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388207616:0@lo:400:kworker.0 00000100:00100000:2.0:1782480987.554554:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388207232 00000100:00100000:2.0:1782480987.554560:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388207232 00000100:00100000:2.0:1782480987.554949:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1782480987.554958:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:3311:x1869066388207232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782480987.555048:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:3311:x1869066388207232:12345-0@lo:400:kworker.0 Request processed in 92us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480987.555055:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1782480987.555156:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ffb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3311:1869066388207232:0@lo:400:kworker.0 00010000:00010000:0.0:1782480987.807559:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782480988.169435:0:14640:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffca1c09480 20000000:00000080:0.0:1782480988.169454:0:14640:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d800d01c00 uarg=0000000000000000 20000000:01000000:0.0:1782480988.169506:0:14640:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1782480988.169515:0:14640:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1782480988.169520:0:14640:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1782480988.170916:0:14641:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:1.0:1782480988.171051:0:14640:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:1.0:1782480988.177275:0:14640:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782480988.177375:0:14640:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480988.177399:0:14640:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf61ab lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf61a4 expref: 11 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480988.177408:0:14640:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480988.177457:0:14640:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf61ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf61a4 expref: 11 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480988.177487:0:14640:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf61ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf61a4 expref: 11 pid: 14202 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480988.177502:0:14640:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14640:1869066388207744:0@lo:104: 00000100:00100000:1.0:1782480988.177570:0:14640:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480988.177725:0:14640:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c6ba2540 going to sleep for 11 seconds 00000100:00100000:3.0:1782480988.178095:0:14191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388207744 00000100:00100000:3.0:1782480988.178104:0:14191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388207744 00000100:00100000:3.0:1782480988.178198:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480988.178207:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+3:14640:x1869066388207744:12345-0@lo:104: 00010000:00010000:3.0:1782480988.178236:0:14191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480988.178331:0:14191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782480988.178339:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+3:14640:x1869066388207744:12345-0@lo:104: Request processed in 133us (769us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480988.178346:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782480988.178411:0:14640:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14640:1869066388207744:0@lo:104: 00010000:00010000:1.0:1782480988.178429:0:14640:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.178631:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480988.178639:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.178647:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e400 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480988.178651:0:14195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.178681:0:14195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480988.178701:0:14195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480988.178708:0:14195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1782480988.178747:0:14195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.178755:0:14195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480988.178777:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.178784:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e400/0x4776e02a9acf61a4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf61ab expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.178803:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480988.178805:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480988.178807:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480988.178818:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3312:1869066388207872:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480988.178851:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480988.178897:0:14192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388207872 00000100:00100000:0.0:1782480988.178901:0:14192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388207872 00010000:00010000:0.0:1782480988.178922:0:14192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf61ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf61a4 expref: 12 pid: 14202 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480988.178962:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782480988.178970:0:14192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:3312:x1869066388207872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480988.178980:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782480988.178985:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf61ab lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf61a4 expref: 12 pid: 14202 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179002:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf61ab lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf61a4 expref: 12 pid: 14202 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179016:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297a400/0x4776e02a9acf61ab lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf61a4 expref: 12 pid: 14202 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179030:0:14192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179038:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179053:0:14192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179061:0:14192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179068:0:14192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179075:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179081:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782480988.179086:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179093:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179114:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480988.179123:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782480988.179152:0:14192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:3312:x1869066388207872:12345-0@lo:103:ldlm_bl.0 Request processed in 183us (299us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480988.179159:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:1.0:1782480988.179402:0:14640:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480988.179411:0:14640:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480988.179418:0:14640:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7ef55e800/0x4776e02a9acf61ea lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14640 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480988.181540:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3312:1869066388207872:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782480988.831500:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782480989.867007:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1782480990.046818:0:14204:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782480990.046831:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7fe76b000 from 10 10000000:01000000:1.0:1782480990.046838:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480990.046908:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480990.046920:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480990.046931:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480990.046959:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388208000:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782480990.047105:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480990.047192:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c622e480 going to sleep for 11 seconds 00000100:00100000:0.0:1782480990.047340:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388208000 00000100:00100000:0.0:1782480990.047349:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388208000 00000100:00100000:0.0:1782480990.047423:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1782480990.047442:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+11:14204:x1869066388208000:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782480990.047457:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782480990.047474:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297b000/0x4776e02a9acf61f8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf61f1 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480990.047502:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297b000/0x4776e02a9acf61f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf61f1 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480990.047514:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297b000/0x4776e02a9acf61f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf61f1 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480990.047524:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b000, rc 0) 00000100:00100000:0.0:1782480990.047581:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14204:x1869066388208000:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 140us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480990.047589:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782480990.047704:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388208000:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782480990.047718:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480990.047726:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480990.047785:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388208128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480990.047814:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480990.047848:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7fe9b90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480990.047910:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388208128 00000100:00100000:3.0:1782480990.047915:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388208128 00000100:00100000:3.0:1782480990.047949:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1782480990.047956:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14204:x1869066388208128:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1782480990.048264:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14204:x1869066388208128:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (448us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480990.048272:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782480990.048422:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388208128:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782480990.048463:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388208256:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782480990.048502:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480990.048530:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7fe9b90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782480990.048582:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388208256 00000100:00100000:3.0:1782480990.048586:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388208256 00000100:00100000:3.0:1782480990.048604:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1782480990.048610:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14204:x1869066388208256:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782480990.048786:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14204:x1869066388208256:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 176us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480990.048794:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782480990.048874:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388208256:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782480990.049760:0:14702:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1782480990.050078:0:14204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1782480990.050102:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782480990.050117:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480990.050148:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782480990.367119:0:14240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1782480990.881286:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480991.907410:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782480992.672191:0:13805:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782480992.672198:0:13805:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782480992.672201:0:13805:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782480992.672204:0:13805:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782480992.672248:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388208512:0@lo:400:kworker.0 00000100:00100000:3.0:1782480992.672327:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480992.672425:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388208512 00000100:00100000:3.0:1782480992.672435:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388208512 00000100:00100000:3.0:1782480992.672507:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782480992.672516:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388208512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480992.672571:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388208512:12345-0@lo:400:kworker.0 Request processed in 55us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480992.672579:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1782480992.672624:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d7efe71880 x1869066388208512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481008 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480992.672637:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388208512:0@lo:400:kworker.0 00000100:00100000:1.0:1782480992.672732:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388208384:0@lo:400:kworker.0 00000100:00100000:1.0:1782480992.672786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480992.673377:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388208384 00000100:00100000:3.0:1782480992.673392:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388208384 00000100:00100000:3.0:1782480992.673433:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1782480992.673440:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:3313:x1869066388208384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480992.673526:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:3313:x1869066388208384:12345-0@lo:400:kworker.0 Request processed in 77us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480992.673532:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1782480992.673765:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388208384:0@lo:400:kworker.0 00010000:00010000:2.0:1782480992.927996:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782480993.321519:0:14841:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782480993.321524:0:14841:0:(obd_mount.c:917:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1782480993.322318:0:14841:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91d7c52ce800 00000020:01000004:2.0:1782480993.322339:0:14841:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782480993.322354:0:14841:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1782480993.322377:0:14841:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff91d7ef0499c0) 00000020:00000080:2.0:1782480993.322396:0:14841:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1782480993.345518:0:14841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1782480993.345839:0:14841:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:3.0:1782480993.346849:0:14841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1782480993.347068:0:14841:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:3.0:1782480993.347578:0:14841:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:3.0:1782480993.348296:0:14841:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 675: rc = 0 00100000:10000000:3.0:1782480993.348467:0:14841:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 675: rc = 0 00100000:10000000:3.0:1782480993.352556:0:14841:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 675: rc = 0 00100000:10000000:3.0:1782480993.353888:0:14841:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 544: rc = 0 00100000:10000000:3.0:1782480993.355442:0:14841:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 544: rc = 0 00100000:10000000:3.0:1782480993.355927:0:14841:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 544: rc = 0 00100000:10000000:3.0:1782480993.356195:0:14841:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 544: rc = 0 00100000:10000000:3.0:1782480993.356843:0:14841:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 544: rc = 0 00100000:10000000:3.0:1782480993.357401:0:14841:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 544: rc = 0 00000020:00000080:3.0:1782480993.358482:0:14841:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1782480993.358509:0:14841:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:3.0:1782480993.358521:0:14841:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4776e02a9acf6206 00000020:01000004:3.0:1782480993.358546:0:14841:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1782480993.358568:0:14841:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1782480993.358572:0:14841:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1782480993.358646:0:14841:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1782480993.358652:0:14841:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1782480993.358691:0:14841:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff91d7ed2199c0) 00000020:00000080:3.0:1782480993.358703:0:14841:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:3.0:1782480993.362430:0:14841:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782480993.363467:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1782480993.363475:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1782480993.380574:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1782480993.380590:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:3.0:1782480993.381062:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:3.0:1782480993.381069:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1782480993.383523:0:14841:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1782480993.384022:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1782480993.384030:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1782480993.385036:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1782480993.385044:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:2.0:1782480993.408463:0:14841:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480993.408709:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1782480993.408716:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1782480993.410349:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1782480993.410364:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1782480993.411398:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1782480993.411407:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1782480993.418819:0:14841:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1782480993.419050:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1782480993.419055:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1782480993.420099:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1782480993.420108:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:3.0:1782480993.459006:0:14841:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1782480993.459217:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:3.0:1782480993.459224:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1782480993.463336:0:14841:0:(service.c:3461:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1782480993.463390:0:14841:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1782480993.464798:0:14841:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1782480993.464822:0:14841:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1782480993.464893:0:14841:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1782480993.479541:0:14841:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782480993.479599:0:14841:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.201.158@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1782480993.479604:0:14841:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782480993.479606:0:14841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782480993.479608:0:14841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480993.479609:0:14841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480993.479611:0:14841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480993.479612:0:14841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480993.479613:0:14841:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782480993.479615:0:14841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480993.479616:0:14841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782480993.479619:0:14841:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1782480993.479622:0:14841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782480993.479623:0:14841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782480993.479624:0:14841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480993.479626:0:14841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480993.479627:0:14841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480993.479628:0:14841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480993.479629:0:14841:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782480993.479630:0:14841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480993.479631:0:14841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782480993.480134:0:14841:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1782480993.480174:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388208640:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782480993.480260:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480993.480419:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c52f2900 going to sleep for 11 seconds 00000100:00100000:1.0:1782480993.480475:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388208640 00000100:00100000:1.0:1782480993.480484:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388208640 00000100:00100000:1.0:1782480993.480570:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1782480993.480590:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14841:x1869066388208640:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782480993.480631:0:14200:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:1.0:1782480993.480634:0:14200:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:1.0:1782480993.480638:0:14200:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:0.0:1782480993.490770:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14841:x1869066388208640:12345-0@lo:253:mount.lustre.0 Request processed in 10140us (10468us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480993.490808:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1782480993.491090:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388208640:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782480993.491108:0:14841:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:3.0:1782480993.491112:0:14841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782480993.491114:0:14841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1782480993.491115:0:14841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782480993.491117:0:14841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782480993.491118:0:14841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782480993.491120:0:14841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782480993.491122:0:14841:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782480993.491123:0:14841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782480993.491125:0:14841:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782480993.491152:0:14841:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d7c52ce800 from lustre-OST0000 10000000:01000000:3.0:1782480993.491196:0:14841:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:3.0:1782480993.491200:0:14841:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1782480993.491220:0:14841:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91d7ff0c19c0 local copy 00010000:00010000:3.0:1782480993.491338:0:14841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6103 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480993.491681:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388208768:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480993.491757:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480993.491941:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c52f20c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782480993.492430:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388208768 00000100:00100000:1.0:1782480993.492440:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388208768 00000100:00100000:1.0:1782480993.492539:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1782480993.492550:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14841:x1869066388208768:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480993.492808:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14841:x1869066388208768:12345-0@lo:501:mount.lustre.0 Request processed in 259us (1050us total) trans 0 rc -2/-2 00000100:00100000:1.0:1782480993.492817:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1782480993.492900:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388208768:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1782480993.492920:0:14841:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1782480993.493083:0:14841:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1782480993.493092:0:14841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6103 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.493113:0:14841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6103 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480993.493142:0:14841:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d7c52ce800 10000000:01000000:2.0:1782480993.493148:0:14841:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1782480993.493152:0:14841:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff91d7ff0c19c0 10000000:01000000:2.0:1782480993.493155:0:14841:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1782480993.493158:0:14841:0:(mgc_request.c:1803:mgc_process_log()) Process log nodemap-ffff91d7ff0c19c0 from 1 10000000:01000000:2.0:1782480993.493160:0:14841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1782480993.493193:0:14841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c400/0x4776e02a9acf6214 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.493201:0:14841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c400/0x4776e02a9acf6214 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.493222:0:14841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c400/0x4776e02a9acf6214 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480993.493248:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388208896:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782480993.493280:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480993.493612:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d800c7a000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480993.493719:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388208896 00000100:00100000:3.0:1782480993.493725:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388208896 00000100:00100000:3.0:1782480993.493759:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1782480993.493767:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+12:14841:x1869066388208896:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480993.493781:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480993.493797:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf621b lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6214 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480993.493832:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf621b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6214 expref: 13 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480993.493843:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779b200/0x4776e02a9acf621b lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6214 expref: 13 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480993.493852:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b200, rc 0) 00000100:00100000:3.0:1782480993.493884:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+13:14841:x1869066388208896:12345-0@lo:101:mount.lustre.0 Request processed in 117us (603us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480993.493891:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1782480993.493962:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388208896:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782480993.493975:0:14841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c400/0x4776e02a9acf6214 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf621b expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.493983:0:14841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c400/0x4776e02a9acf6214 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf621b expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480993.494012:0:14841:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1782480993.494026:0:14841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c400/0x4776e02a9acf6214 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf621b expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.494034:0:14841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c400/0x4776e02a9acf6214 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf621b expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782480993.494039:0:14841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1782480993.494043:0:14841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1782480993.494048:0:14841:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1782480993.494050:0:14841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1782480993.494066:0:14841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c800/0x4776e02a9acf6222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.494073:0:14841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c800/0x4776e02a9acf6222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.494080:0:14841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c800/0x4776e02a9acf6222 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782480993.494093:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209024:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1782480993.494119:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480993.494137:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d800c7a000 going to sleep for 11 seconds 00000100:00100000:3.0:1782480993.494186:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388209024 00000100:00100000:3.0:1782480993.494190:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388209024 00000100:00100000:3.0:1782480993.494326:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1782480993.494335:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+13:14841:x1869066388209024:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480993.494342:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480993.494350:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf6229 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6222 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480993.494375:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf6229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6222 expref: 14 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480993.494384:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779be00/0x4776e02a9acf6229 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6222 expref: 14 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480993.494390:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779be00, rc 0) 00000100:00100000:3.0:1782480993.494464:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+14:14841:x1869066388209024:12345-0@lo:101:mount.lustre.0 Request processed in 130us (343us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480993.494481:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1782480993.494789:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209024:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782480993.494800:0:14841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c800/0x4776e02a9acf6222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6229 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.494807:0:14841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c800/0x4776e02a9acf6222 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf6229 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782480993.495613:0:14841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1782480993.503521:0:14841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782480993.503878:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1782480993.503927:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1782480993.503962:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1782480993.504026:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1782480993.504063:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1782480993.504098:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1782480993.504165:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1782480993.504174:0:14841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1782480993.504331:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782480993.504946:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480993.504997:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d800c7af00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480993.505060:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388209152 00000100:00100000:3.0:1782480993.505068:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388209152 00000100:00100000:3.0:1782480993.505124:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1782480993.505133:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+14:14841:x1869066388209152:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782480993.505756:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+14:14841:x1869066388209152:12345-0@lo:501:mount.lustre.0 Request processed in 621us (810us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480993.505765:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1782480993.505963:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209152:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782480993.506017:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209280:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782480993.506058:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480993.506082:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d800c7af00 going to sleep for 11 seconds 00000100:00100000:3.0:1782480993.506135:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388209280 00000100:00100000:3.0:1782480993.506141:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388209280 00000100:00100000:3.0:1782480993.506206:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1782480993.506223:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+14:14841:x1869066388209280:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782480993.506892:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+14:14841:x1869066388209280:12345-0@lo:503:mount.lustre.0 Request processed in 667us (830us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480993.506900:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1782480993.508215:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209280:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1782480993.510460:0:14841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1782480993.510558:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209408:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480993.510679:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480993.510738:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d800c7af00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480993.511056:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388209408 00000100:00100000:0.0:1782480993.511064:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388209408 00000100:00100000:0.0:1782480993.511115:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:0.0:1782480993.511126:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+14:14841:x1869066388209408:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782480993.511558:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+14:14841:x1869066388209408:12345-0@lo:502:mount.lustre.0 Request processed in 432us (900us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480993.511567:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1782480993.511810:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209408:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1782480993.514129:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1782480993.514528:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1782480993.514580:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1782480993.514635:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1782480993.514785:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1782480993.514977:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1782480993.515081:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1782480993.515172:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1782480993.515467:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:2.0:1782480993.515557:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:2.0:1782480993.515599:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:2.0:1782480993.515647:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:2.0:1782480993.515864:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209536:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480993.516167:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480993.516392:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d800c7af00 going to sleep for 11 seconds 00000100:00100000:0.0:1782480993.516438:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388209536 00000100:00100000:0.0:1782480993.516446:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388209536 00000100:00100000:0.0:1782480993.516575:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782480993.516586:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+14:14841:x1869066388209536:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480993.517268:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+14:14841:x1869066388209536:12345-0@lo:502:mount.lustre.0 Request processed in 659us (1077us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480993.517277:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1782480993.517486:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209536:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782480993.517591:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:0.0:1782480993.517606:0:14841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1782480993.520525:0:14855:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1782480993.520536:0:14855:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1782480993.520543:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.520545:0:14855:0:(obd_config.c:1561:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1782480993.520551:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1782480993.520566:0:14855:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff91d7ef048000) 00000020:00000080:2.0:1782480993.520588:0:14855:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1782480993.520593:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1782480993.520824:0:14855:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d7c52ce800 from lustre-OST0000, refs=2 00080000:01000000:2.0:1782480993.520856:0:14855:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:2.0:1782480993.520864:0:14855:0:(genops.c:1406:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x4776e02a9acf6237 00010000:00010000:2.0:1782480993.528848:0:14855:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:2.0:1782480993.529640:0:14855:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1782480993.532531:0:14855:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1782480993.535161:0:14855:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1782480993.535180:0:14855:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480993.535187:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.535189:0:14855:0:(obd_config.c:1561:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1782480993.535192:0:14855:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1782480993.535195:0:14855:0:(obd_config.c:1899:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1782480993.535196:0:14855:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782480993.535197:0:14855:0:(obd_config.c:1925:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1782480993.535199:0:14855:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1782480993.535201:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.535202:0:14855:0:(obd_config.c:1561:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1782480993.535205:0:14855:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480993.535420:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.535422:0:14855:0:(obd_config.c:1561:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1782480993.535428:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1782480993.535430:0:14855:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1782480993.535432:0:14855:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480993.535434:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.535435:0:14855:0:(obd_config.c:1561:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1782480993.535437:0:14855:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480993.535439:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.535440:0:14855:0:(obd_config.c:1561:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1782480993.535443:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1782480993.535515:0:14855:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480993.535518:0:14855:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.535519:0:14855:0:(obd_config.c:1561:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1782480993.535524:0:14855:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1782480993.535751:0:14841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1782480993.535779:0:14841:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1782480993.535804:0:14841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c800/0x4776e02a9acf6222 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6229 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.535816:0:14841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7fee2c800/0x4776e02a9acf6222 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6229 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480993.535825:0:14841:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c52ce800 from 1 10000000:01000000:1.0:1782480993.535829:0:14841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782480993.535877:0:14841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.535887:0:14841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.535960:0:14841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480993.536032:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209664:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782480993.536545:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480993.536597:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072900 going to sleep for 11 seconds 00000100:00100000:3.0:1782480993.536789:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388209664 00000100:00100000:3.0:1782480993.536814:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388209664 00000100:00100000:3.0:1782480993.536882:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1782480993.536903:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+14:14841:x1869066388209664:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782480993.536931:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480993.536974:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779aa00/0x4776e02a9acf6245 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf623e expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480993.537046:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779aa00/0x4776e02a9acf6245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf623e expref: 15 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480993.537056:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779aa00/0x4776e02a9acf6245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf623e expref: 15 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480993.537077:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779aa00, rc 0) 00000100:00100000:3.0:1782480993.537130:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388209664:12345-0@lo:101:mount.lustre.0 Request processed in 240us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480993.537137:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1782480993.537427:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209664:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782480993.537444:0:14841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.537452:0:14841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480993.538540:0:14841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1782480993.542476:0:14841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480993.543497:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1782480993.543569:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1782480993.543637:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1782480993.543646:0:14841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1782480993.544515:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480993.544594:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480993.545428:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480993.548885:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388209792 00000100:00100000:2.0:1782480993.548900:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388209792 00000100:00100000:2.0:1782480993.548956:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1782480993.548965:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388209792:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782480993.549528:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388209792:12345-0@lo:501:mount.lustre.0 Request processed in 561us (4931us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480993.549538:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1782480993.549635:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209792:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480993.549735:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209920:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782480993.549779:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480993.549807:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480993.549979:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388209920 00000100:00100000:2.0:1782480993.549997:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388209920 00000100:00100000:2.0:1782480993.550048:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1782480993.550056:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388209920:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782480993.550328:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388209920:12345-0@lo:503:mount.lustre.0 Request processed in 272us (548us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480993.550334:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1782480993.550531:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388209920:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782480993.551410:0:14841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782480993.551498:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210048:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782480993.551552:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480993.551587:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480993.551833:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388210048 00000100:00100000:2.0:1782480993.551840:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388210048 00000100:00100000:2.0:1782480993.551875:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1782480993.551883:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388210048:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480993.552061:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388210048:12345-0@lo:502:mount.lustre.0 Request processed in 177us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480993.552068:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1782480993.552418:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210048:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782480993.552856:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1782480993.552910:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1782480993.552959:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1782480993.553038:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1782480993.553073:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1782480993.554255:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1782480993.554304:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1782480993.554351:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1782480993.554431:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210176:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782480993.554546:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480993.554592:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072900 going to sleep for 11 seconds 00000100:00100000:2.0:1782480993.555010:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388210176 00000100:00100000:2.0:1782480993.555017:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388210176 00000100:00100000:2.0:1782480993.555092:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1782480993.555100:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388210176:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480993.555467:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388210176:12345-0@lo:502:mount.lustre.0 Request processed in 367us (921us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480993.555476:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1782480993.555571:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210176:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782480993.555724:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1782480993.555735:0:14841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1782480993.557647:0:14859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480993.557744:0:14859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.557746:0:14859:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1782480993.557768:0:14859:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d7c52ce800 00000020:00000080:2.0:1782480993.557771:0:14859:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782480993.557778:0:14859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480993.557794:0:14859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.557803:0:14859:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1782480993.557807:0:14859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480993.557811:0:14859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.557812:0:14859:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1782480993.557829:0:14859:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d7c52ce800 00000020:00000080:2.0:1782480993.557832:0:14859:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782480993.557948:0:14859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480993.557952:0:14859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.557953:0:14859:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1782480993.557956:0:14859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1782480993.557958:0:14859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.557959:0:14859:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1782480993.557962:0:14859:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d7c52ce800 00000020:00000080:2.0:1782480993.557964:0:14859:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1782480993.558048:0:14859:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1782480993.558051:0:14859:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1782480993.558053:0:14859:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1782480993.558055:0:14859:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:1.0:1782480993.560385:0:14841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:1.0:1782480993.560466:0:14841:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1782480993.560511:0:14841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.560539:0:14841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1782480993.560594:0:14841:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1782480993.560597:0:14841:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d7c52ce800 10000000:01000000:1.0:1782480993.560600:0:14841:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d7c52ce800 10000000:01000000:1.0:1782480993.560611:0:14841:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1782480993.560618:0:14841:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d7c52ce800 from 1 10000000:01000000:1.0:1782480993.560621:0:14841:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1782480993.560717:0:14841:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fa00/0x4776e02a9acf624c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.560741:0:14841:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fa00/0x4776e02a9acf624c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.560751:0:14841:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fa00/0x4776e02a9acf624c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480993.560790:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210304:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1782480993.560871:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480993.560914:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480993.561011:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388210304 00000100:00100000:2.0:1782480993.561018:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388210304 00000100:00100000:2.0:1782480993.561074:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1782480993.561091:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388210304:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782480993.561108:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782480993.561124:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2ce00/0x4776e02a9acf6253 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf624c expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.561146:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2ce00/0x4776e02a9acf6253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf624c expref: 16 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.561157:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2ce00/0x4776e02a9acf6253 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf624c expref: 16 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.561177:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2ce00, rc 0) 00000100:00100000:2.0:1782480993.562234:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14841:x1869066388210304:12345-0@lo:101:mount.lustre.0 Request processed in 1139us (1350us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480993.562244:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1782480993.562604:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210304:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782480993.562629:0:14841:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fa00/0x4776e02a9acf624c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6253 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.562641:0:14841:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fa00/0x4776e02a9acf624c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf6253 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782480993.563556:0:14841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:1.0:1782480993.563928:0:14841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782480993.567801:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:1.0:1782480993.567979:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:1.0:1782480993.568051:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:1.0:1782480993.568181:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:1.0:1782480993.572471:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:1.0:1782480993.572569:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:1.0:1782480993.572622:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:1.0:1782480993.572655:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:1.0:1782480993.572753:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:1.0:1782480993.572792:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:1.0:1782480993.572825:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:1.0:1782480993.572891:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:1.0:1782480993.572928:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:1.0:1782480993.572961:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:1.0:1782480993.573010:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:1.0:1782480993.573048:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:1.0:1782480993.573085:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:1.0:1782480993.573134:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:1.0:1782480993.573172:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:1.0:1782480993.576424:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:1.0:1782480993.576587:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:1.0:1782480993.576625:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:1.0:1782480993.576674:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:1.0:1782480993.576762:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:1.0:1782480993.576834:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:1.0:1782480993.576990:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:1.0:1782480993.583975:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:1.0:1782480993.584107:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:1.0:1782480993.584203:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:1.0:1782480993.584211:0:14841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:1.0:1782480993.584451:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480993.584522:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480993.584575:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480993.587262:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388210432 00000100:00100000:0.0:1782480993.587280:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388210432 00000100:00100000:0.0:1782480993.587341:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:0.0:1782480993.587358:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14841:x1869066388210432:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782480993.587720:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14841:x1869066388210432:12345-0@lo:501:mount.lustre.0 Request processed in 363us (3196us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480993.587728:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1782480993.588158:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210432:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782480993.588307:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210560:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782480993.588359:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480993.588417:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072300 going to sleep for 11 seconds 00000100:00100000:0.0:1782480993.589475:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388210560 00000100:00100000:0.0:1782480993.589496:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388210560 00000100:00100000:0.0:1782480993.591518:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1782480993.591539:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14841:x1869066388210560:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782480993.591880:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14841:x1869066388210560:12345-0@lo:503:mount.lustre.0 Request processed in 348us (3519us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480993.591905:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1782480993.594271:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210560:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782480993.595303:0:14841:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782480993.595524:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210688:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782480993.595607:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480993.598555:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480993.603397:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388210688 00000100:00100000:2.0:1782480993.603427:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388210688 00000100:00100000:2.0:1782480993.603530:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1782480993.603559:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14841:x1869066388210688:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480993.603957:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14841:x1869066388210688:12345-0@lo:502:mount.lustre.0 Request processed in 416us (8349us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480993.603966:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1782480993.605472:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210688:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782480993.605913:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1782480993.606008:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1782480993.606042:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1782480993.606866:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1782480993.606973:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1782480993.607358:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1782480993.607410:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1782480993.607443:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1782480993.607507:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1782480993.607546:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1782480993.607582:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1782480993.608177:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1782480993.608474:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1782480993.608529:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1782480993.608610:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1782480993.608645:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1782480993.608789:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1782480993.608923:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1782480993.609003:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1782480993.609202:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1782480993.609410:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1782480993.609476:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1782480993.609543:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1782480993.609605:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1782480993.609644:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1782480993.610197:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1782480993.611459:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1782480993.611556:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1782480993.611595:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1782480993.611646:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1782480993.611720:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1782480993.611804:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1782480993.611873:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1782480993.611968:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1782480993.612042:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1782480993.613445:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1782480993.613561:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1782480993.613599:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1782480993.613645:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1782480993.613701:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1782480993.613754:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210816:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782480993.613830:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782480993.613876:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480993.613962:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388210816 00000100:00100000:2.0:1782480993.613969:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388210816 00000100:00100000:2.0:1782480993.614361:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1782480993.614384:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14841:x1869066388210816:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782480993.614730:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14841:x1869066388210816:12345-0@lo:502:mount.lustre.0 Request processed in 348us (899us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480993.614752:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1782480993.615482:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388210816:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782480993.615620:0:14841:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1782480993.615637:0:14841:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1782480993.617972:0:14864:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1782480993.617992:0:14864:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff91d7f4cc3380) 00000020:00000080:1.0:1782480993.618014:0:14864:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1782480993.618176:0:14864:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d7c52ce800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782480993.618181:0:14864:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d7c52ce800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1782480993.618183:0:14864:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d7c52ce800 3 00010000:00080000:1.0:1782480993.620323:0:14864:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d7c4af2000@lustre-MDT0000-lwp-OST0000: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1782480993.624764:0:14864:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1782480993.626602:0:14864:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1782480993.626645:0:14864:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782480993.626692:0:14864:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x4776e02a9acf6261 00000100:00080000:1.0:1782480993.626703:0:14864:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782480993.626709:0:14864:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff91d7c4af2000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:1.0:1782480993.626745:0:14864:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d6c1e77480 x1869066388210944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1782480993.626765:0:14864:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1782480993.627095:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1869066388210944:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1782480993.627401:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1782480993.627417:0:13805:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782480993.627422:0:13805:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1782480993.627425:0:13805:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782480993.627428:0:13805:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782480993.627550:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388210944 00000100:00100000:3.0:1782480993.627558:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388210944 00000100:00100000:3.0:1782480993.627691:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480993.627700:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3309:x1869066388210944:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1782480993.627723:0:14207:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 524 last 0 00000020:00000080:3.0:1782480993.627762:0:14207:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x4776e02a9acf6268 00000004:00100000:3.0:1782480993.627778:0:14207:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782480993.627809:0:14207:0:(import.c:65:import_set_state_nolock()) ffff91d7ccadf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782480993.628259:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1869066388210944:12345-0@lo:38:llog_process_th.0 Request processed in 556us (854us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480993.628268:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480993.628300:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388211072:0@lo:400:kworker.0 00000100:00100000:3.0:1782480993.628330:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480993.628375:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388211072 00000100:00100000:3.0:1782480993.628379:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388211072 00000100:00100000:3.0:1782480993.628405:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782480993.628411:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388211072:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480993.628445:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388211072:12345-0@lo:400:kworker.0 Request processed in 34us (115us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480993.628450:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1782480993.628526:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d7ff0b1880 x1869066388211072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481009 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480993.628545:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388211072:0@lo:400:kworker.0 00010000:00080000:0.0:1782480993.628620:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff91d6c1e77480 x1869066388210944/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782481003 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782480993.628629:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782480993.628635:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:0.0:1782480993.628643:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782480993.628648:0:3309:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782480993.628650:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7c4af2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782480993.628655:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1869066388210944:0@lo:38:llog_process_th.0 00000040:00080000:3.0:1782480993.629077:0:14864:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1782480993.629217:0:14841:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782480993.629312:0:14841:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782480993.629328:0:14841:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fa00/0x4776e02a9acf624c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6253 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.629348:0:14841:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7ef55fa00/0x4776e02a9acf624c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6253 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782480993.629400:0:14841:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782480993.629401:0:14841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782480993.629403:0:14841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480993.629404:0:14841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480993.629405:0:14841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480993.629406:0:14841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480993.629407:0:14841:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480993.629409:0:14841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480993.629410:0:14841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782480993.629414:0:14841:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:2.0:1782480993.629415:0:14841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782480993.629416:0:14841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782480993.629417:0:14841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480993.629417:0:14841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480993.629418:0:14841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480993.629419:0:14841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480993.629419:0:14841:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480993.629420:0:14841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480993.629421:0:14841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782480993.629436:0:14841:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1782480993.629448:0:14841:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388211200:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782480993.629489:0:14841:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782480993.629516:0:14841:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c5760000 going to sleep for 11 seconds 00000100:00100000:0.0:1782480993.629526:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388211200 00000100:00100000:0.0:1782480993.629537:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388211200 00000100:00100000:0.0:1782480993.629573:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1782480993.629580:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14841:x1869066388211200:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782480993.629603:0:14201:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1782480993.629617:0:14201:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:2.0:1782480993.659684:0:14201:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1782480993.659706:0:14201:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1782480993.660060:0:14222:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782480993.660066:0:14222:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782480993.660099:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.660369:0:14222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf61dc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf61d5 expref: 16 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.660380:0:14222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.660428:0:14222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf61dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf61d5 expref: 16 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.660443:0:14222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf61dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf61d5 expref: 16 pid: 14201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480993.660458:0:14222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14222:1869066388211328:0@lo:104: 00000100:00100000:0.0:1782480993.660539:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480993.660599:0:14222:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d2589180 going to sleep for 11 seconds 00000100:00100000:2.0:1782480993.662126:0:14190:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388211328 00000100:00100000:2.0:1782480993.662141:0:14190:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388211328 00000100:00100000:2.0:1782480993.662218:0:14190:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782480993.662229:0:14190:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+3:14222:x1869066388211328:12345-0@lo:104: 00010000:00010000:2.0:1782480993.662245:0:14190:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480993.662338:0:14190:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1782480993.662345:0:14190:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+3:14222:x1869066388211328:12345-0@lo:104: Request processed in 119us (1806us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480993.662353:0:14190:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1782480993.663645:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782480993.663674:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.663687:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:0.0:1782480993.663692:0:14195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.663713:0:14195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1782480993.663720:0:14195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782480993.663726:0:14195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1782480993.663773:0:14195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.663779:0:14195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1782480993.663858:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.663867:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c779a600/0x4776e02a9acf61d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf61dc expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.663926:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480993.663928:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782480993.663930:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782480993.663970:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782480993.663998:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388211456:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782480993.665322:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782480993.665503:0:14222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14222:1869066388211328:0@lo:104: 00010000:00010000:0.0:1782480993.665540:0:14222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480993.665642:0:14194:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388211456 00000100:00100000:1.0:1782480993.665720:0:14194:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388211456 00010000:00010000:1.0:1782480993.665782:0:14194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf61dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf61d5 expref: 17 pid: 14201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782480993.665845:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782480993.665855:0:14194:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:3313:x1869066388211456:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782480993.665886:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782480993.665892:0:14194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf61dc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf61d5 expref: 17 pid: 14201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.665918:0:14194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf61dc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf61d5 expref: 17 pid: 14201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.665965:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779a400/0x4776e02a9acf61dc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf61d5 expref: 17 pid: 14201 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.665998:0:14194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.666007:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1782480993.666138:0:14194:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006072188s 00010000:00010000:1.0:1782480993.666159:0:14194:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.667451:0:14194:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.667488:0:14194:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.667514:0:14194:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.667541:0:14194:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782480993.667546:0:14194:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.667575:0:14194:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.667764:0:14194:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782480993.667816:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782480993.668089:0:14194:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:3313:x1869066388211456:12345-0@lo:103:ldlm_bl.0 Request processed in 2231us (2768us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480993.668107:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388211456:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1782480993.668143:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:0.0:1782480993.668641:0:14222:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.668693:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782480993.668700:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf626f lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782480993.674646:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14841:x1869066388211200:12345-0@lo:253:mount.lustre.0 Request processed in 45053us (45143us total) trans 0 rc 0/0 00000100:00100000:0.0:1782480993.674686:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1782480993.674800:0:14841:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14841:1869066388211200:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782480993.674814:0:14841:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1782480993.674817:0:14841:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782480993.674818:0:14841:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1782480993.674819:0:14841:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782480993.674821:0:14841:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782480993.674822:0:14841:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782480993.674823:0:14841:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782480993.674825:0:14841:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782480993.674827:0:14841:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782480993.674828:0:14841:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782480993.674848:0:14841:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782480993.681869:0:14841:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480993.682270:0:14841:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480993.682446:0:14841:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480993.682619:0:14841:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782480993.682793:0:14841:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1782480993.683160:0:14841:0:(osd_index.c:2102:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:1.0:1782480993.685097:0:14841:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1782480993.779977:0:14841:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1782480993.779987:0:14841:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1782480993.780350:0:14841:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1782480993.780432:0:14841:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1782480993.780446:0:14841:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1782480993.780474:0:14841:0:(super25.c:187:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1782480993.953153:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480994.981714:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782480995.370599:0:14204:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782480995.370607:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91d7fe76b000 from 7 10000000:01000000:3.0:1782480995.370614:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782480995.370683:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480995.370696:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480995.370709:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480995.370738:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388211584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782480995.370808:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480995.370849:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388211584 00000100:00100000:3.0:1782480995.370857:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388211584 00000100:00100000:3.0:1782480995.370912:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782480995.370921:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+15:14204:x1869066388211584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480995.370936:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782480995.370950:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf627d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6276 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480995.370974:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6276 expref: 16 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480995.370985:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6276 expref: 16 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480995.371010:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b000, rc 0) 00000100:00100000:3.0:1782480995.371044:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14204:x1869066388211584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 124us (236us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480995.371051:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1782480995.373229:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c33cd300 going to sleep for 11 seconds 00000100:00100000:3.0:1782480995.373271:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388211584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782480995.373296:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782480995.373307:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782480995.373393:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388211712:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782480995.373453:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480995.373491:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c33cd300 going to sleep for 11 seconds 00000100:00100000:2.0:1782480995.375216:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388211712 00000100:00100000:2.0:1782480995.375228:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388211712 00000100:00100000:2.0:1782480995.375288:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782480995.375299:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14204:x1869066388211712:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1782480995.375342:0:14201:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1782480995.375358:0:14201:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1782480995.375361:0:14201:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1782480995.375487:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14204:x1869066388211712:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 190us (2032us total) trans 0 rc 0/0 00000100:00100000:2.0:1782480995.375494:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1782480995.375548:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388211712:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1782480995.375615:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1782480995.375624:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480995.375635:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782480996.000330:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782480997.028919:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782480998.052795:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1782480998.815987:0:13805:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782480998.815994:0:13805:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1782480998.815996:0:13805:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1782480998.815999:0:13805:0:(pinger.c:249:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1782480998.816049:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388211840:0@lo:400:kworker.0 00000100:00100000:3.0:1782480998.816138:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480998.816215:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388211968:0@lo:400:kworker.0 00000100:00100000:3.0:1782480998.816260:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480998.816307:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782480998.816314:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388212096:0@lo:400:kworker.0 00000100:00100000:3.0:1782480998.816343:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782480998.816376:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388211840 00000100:00100000:3.0:1782480998.816384:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388211840 00000100:00100000:3.0:1782480998.816438:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782480998.816449:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:3313:x1869066388211840:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480998.816503:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:3313:x1869066388211840:12345-0@lo:400:kworker.0 Request processed in 56us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480998.816510:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1782480998.816549:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388211968 00000100:00100000:3.0:1782480998.816553:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388211968 00000100:00100000:3.0:1782480998.816576:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388212096 00000100:00100000:3.0:1782480998.816579:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388212096 00000100:00100000:3.0:1782480998.816615:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782480998.816621:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388211968:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480998.816688:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe71f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388211968:12345-0@lo:400:kworker.0 Request processed in 38us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480998.816695:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782480998.816708:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782480998.816715:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388212096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782480998.816829:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe72d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388212096:12345-0@lo:400:kworker.0 Request processed in 115us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1782480998.816836:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1782480998.816886:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7efe70380 x1869066388212096/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480998.816900:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388212096:0@lo:400:kworker.0 00010000:00080000:3.0:1782480998.816925:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7efe70000 x1869066388211968/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481014 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782480998.816934:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388211968:0@lo:400:kworker.0 00000100:00100000:3.0:1782480998.816960:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388211840:0@lo:400:kworker.0 00000100:00080000:3.0:1782480998.817000:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1782480999.077379:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481000.100272:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782481000.615255:0:14240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1782481001.125457:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1782481002.001570:0:15211:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1782481002.152696:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481002.848128:0:3309:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480987/real 1782480987] req@ffff91d7c30ff480 x1869066388207360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481002 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481002.848171:0:3309:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d7c30ff480 x1869066388207360/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481002 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481002.848182:0:3309:0:(client.c:2489:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1782480987/real 1782480987] req@ffff91d7c30ff100 x1869066388207488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481002 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481002.848253:0:3309:0:(client.c:2520:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff91d7c30ff100 x1869066388207488/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1782481002 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782481002.848271:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7c52a3800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782481002.848294:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782481002.848298:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ff480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388207360:0@lo:8:kworker.0 00000100:00080000:2.0:1782481002.848304:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782481002.848309:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1782481002.848311:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30ff100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388207488:0@lo:8:kworker.0 00000100:00080000:0.0:1782481002.848433:0:13805:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782481002.848438:0:13805:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:0.0:1782481002.848441:0:13805:0:(import.c:65:import_set_state_nolock()) ffff91d7c52a3800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782481002.848445:0:13805:0:(import.c:512:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:0.0:1782481002.848450:0:13805:0:(import.c:591:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1782481002.848457:0:13805:0:(import.c:626:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff91d7c52a3800 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1782481002.848477:0:13805:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7ff0b1c00 x1869066388212352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1782481002.848496:0:13805:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782481002.848499:0:13805:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782481002.848500:0:13805:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782481002.848503:0:13805:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 518 00000100:00080000:0.0:1782481002.848506:0:13805:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:0.0:1782481002.848509:0:13805:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d7c77ca000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1782481002.848519:0:13805:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7ff0b3800 x1869066388212480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782481002.848701:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1782481002.848716:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388212224:0@lo:400:kworker.0 00000100:00100000:1.0:1782481002.848809:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481002.848893:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388212224 00000100:00100000:1.0:1782481002.848903:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388212224 00000100:00100000:1.0:1782481002.848952:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782481002.848960:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:3313:x1869066388212224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481002.849008:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:3313:x1869066388212224:12345-0@lo:400:kworker.0 Request processed in 49us (199us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481002.849014:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1782481002.849069:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388212224:0@lo:400:kworker.0 00000100:00100000:2.0:1782481002.849289:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388212352:0@lo:8:kworker.0 00000100:00100000:2.0:1782481002.849323:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481002.849682:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388212480:0@lo:8:kworker.0 00000100:00100000:2.0:1782481002.849708:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481002.849973:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388212736:0@lo:400:kworker.0 00000100:00100000:3.0:1782481002.850007:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481002.850046:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782481002.850054:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388212608:0@lo:400:kworker.0 00000100:00100000:3.0:1782481002.850079:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481002.850109:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388212736 00000100:00100000:3.0:1782481002.850114:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388212736 00000100:00100000:3.0:1782481002.850155:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388212608 00000100:00100000:3.0:1782481002.850158:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388212608 00000100:00100000:3.0:1782481002.850175:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782481002.850182:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388212736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481002.850237:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe71c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388212736:12345-0@lo:400:kworker.0 Request processed in 56us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481002.850244:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782481002.850257:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782481002.850263:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388212608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481002.850294:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388212608:12345-0@lo:400:kworker.0 Request processed in 32us (215us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481002.850300:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:3.0:1782481002.850317:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782481002.850357:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b0e00 x1869066388212608/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481002.850370:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388212608:0@lo:400:kworker.0 00010000:00080000:3.0:1782481002.850400:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b0000 x1869066388212736/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481018 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481002.850408:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388212736:0@lo:400:kworker.0 00000100:00100000:0.0:1782481002.850736:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388212352 00000100:00100000:0.0:1782481002.850741:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388212352 00000100:00100000:0.0:1782481002.850761:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388212480 00000100:00100000:0.0:1782481002.850764:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388212480 00000100:00100000:0.0:1782481002.850775:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782481002.850793:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1869066388212352:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782481002.850822:0:14844:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 533 last 0 00000020:00000080:0.0:1782481002.850850:0:14844:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4776e02a9acf6284 00002000:00100000:0.0:1782481002.851022:0:14844:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff91d7c52a4800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113662 ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:0.0:1782481002.851027:0:14844:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:0.0:1782481002.851030:0:14844:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782481002.851341:0:14844:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1782481002.851371:0:14844:0:(import.c:65:import_set_state_nolock()) ffff91d7c811b000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481002.851431:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ff100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1869066388212352:12345-0@lo:8:kworker.0 Request processed in 636us (2107us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481002.851437:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782481002.851453:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782481002.851458:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1869066388212480:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1782481002.851468:0:14844:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:0.0:1782481002.851488:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ff480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1869066388212480:12345-0@lo:8:kworker.0 Request processed in 30us (1779us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782481002.851493:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1782481002.851572:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1782481002.851577:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1782481002.851580:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388212480:0@lo:8:kworker.0 00010000:00080000:2.0:1782481002.851591:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b1c00 x1869066388212352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782481022 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1782481002.851599:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1782481002.851605:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782481002.851611:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782481002.851616:0:3309:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1782481002.851618:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7c52a3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782481002.851641:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782481002.851654:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388212352:0@lo:8:kworker.0 00000004:00080000:3.0:1782481002.851950:0:14229:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x6:0x0] 00000100:00100000:3.0:1782481002.851968:0:14229:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14229:1869066388212992:0@lo:5:osp-pre-0-0.0 00000100:00100000:3.0:1782481002.851999:0:14229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481002.852017:0:14229:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d800c7a600 going to sleep for 11 seconds 00000100:00100000:3.0:1782481002.852028:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388212864:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782481002.852048:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481002.852075:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388212992 00000100:00100000:3.0:1782481002.852079:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388212992 00000100:00100000:3.0:1782481002.852109:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1782481002.852115:0:14845:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14229:x1869066388212992:12345-0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1782481002.853050:0:14228:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1782481002.853427:0:14228:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 533414766760ns, next at 0ns, rc = 0 00000100:00100000:2.0:1782481002.853892:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388212864 00000100:00100000:2.0:1782481002.853900:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388212864 00000100:00100000:2.0:1782481002.853938:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1782481002.853945:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1869066388212864:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782481002.853973:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782481002.854047:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe71880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1869066388212864:12345-0@lo:13:osp-pre-0-0.0 Request processed in 103us (1998us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481002.854052:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1782481002.854196:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7efe70380 x1869066388212864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782481018 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481002.854226:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388212864:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1782481002.859064:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:3.0:1782481002.865092:0:14845:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:3.0:1782481002.865123:0:14845:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:3.0:1782481002.865129:0:14845:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:7 to 0x240000400:33) 00002000:00010000:3.0:1782481002.883654:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.883690:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d89a26c/0x4776e02a9acf628b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.883708:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.883712:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.883801:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008d89a26c/0x4776e02a9acf628b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.883821:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008d89a26c/0x4776e02a9acf628b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.883832:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008d89a26c/0x4776e02a9acf628b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.883839:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008d89a26c/0x4776e02a9acf628b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.883862:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782481002.883878:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.883884:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008d89a26c/0x4776e02a9acf628b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.883892:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.883897:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008d89a26c/0x4776e02a9acf628b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.883905:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008d89a26c/0x4776e02a9acf628b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.883921:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008d89a26c/0x4776e02a9acf628b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.883941:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008d89a26c/0x4776e02a9acf628b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.884049:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.884051:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.884053:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481002.885299:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.885317:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf6292 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.885330:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.885340:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.885345:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf6292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.885356:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf6292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.885371:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf6292 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.885379:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf6292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.885405:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782481002.885420:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.886363:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf6292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.886374:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.886378:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf6292 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.886387:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf6292 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.886405:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf6292 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.886411:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf6292 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.886433:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.886435:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.886437:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481002.887462:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.887471:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf6299 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.887483:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.887487:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.887492:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf6299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.887515:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf6299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.887524:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf6299 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.887531:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf6299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.887558:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481002.887811:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481002.887819:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf6299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481002.887836:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481002.887840:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf6299 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481002.887849:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf6299 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481002.887869:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf6299 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481002.887875:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000061d05dcb/0x4776e02a9acf6299 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481002.887896:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481002.887899:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481002.887902:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481002.888067:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.888074:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2eb5027/0x4776e02a9acf62a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.888382:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.888386:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.888390:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e2eb5027/0x4776e02a9acf62a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.888400:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e2eb5027/0x4776e02a9acf62a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.888409:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e2eb5027/0x4776e02a9acf62a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.888427:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e2eb5027/0x4776e02a9acf62a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.888446:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782481002.889225:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.889233:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071787ff7/0x4776e02a9acf62a7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889244:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.889248:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.889252:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000071787ff7/0x4776e02a9acf62a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889262:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000071787ff7/0x4776e02a9acf62a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889271:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000071787ff7/0x4776e02a9acf62a7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889278:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000071787ff7/0x4776e02a9acf62a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889298:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782481002.889310:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481002.889315:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e2eb5027/0x4776e02a9acf62a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889330:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779ba00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.889334:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2eb5027/0x4776e02a9acf62a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889344:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e2eb5027/0x4776e02a9acf62a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889359:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e2eb5027/0x4776e02a9acf62a0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889368:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e2eb5027/0x4776e02a9acf62a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889387:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.889391:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000071787ff7/0x4776e02a9acf62a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889398:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779bc00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.889401:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000071787ff7/0x4776e02a9acf62a7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889409:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000071787ff7/0x4776e02a9acf62a7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889418:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000071787ff7/0x4776e02a9acf62a7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889433:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000071787ff7/0x4776e02a9acf62a7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.889448:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.889450:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.889452:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481002.890427:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.890436:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf62ae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.890449:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.890453:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.890457:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf62ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.890469:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf62ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.890478:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf62ae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.890486:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf62ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.890507:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782481002.890520:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.890532:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf62ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.890539:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.890559:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf62ae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.890568:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf62ae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.890591:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf62ae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.890599:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fcf4db32/0x4776e02a9acf62ae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.890626:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.890628:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.890630:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481002.891088:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481002.892386:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.892398:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf62b5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.892414:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.892418:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.892423:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf62b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.892464:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf62b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.892474:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf62b5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.892481:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf62b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.892516:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481002.892769:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481002.892791:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf62b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.892802:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a600 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481002.892807:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf62b5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.892824:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf62b5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.892847:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf62b5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.892855:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000079b797e1/0x4776e02a9acf62b5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.892881:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.892884:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.892886:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481002.893436:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.893450:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa0fe0a/0x4776e02a9acf62bc lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.893463:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.893467:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.893471:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efa0fe0a/0x4776e02a9acf62bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.893488:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efa0fe0a/0x4776e02a9acf62bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.893497:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efa0fe0a/0x4776e02a9acf62bc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.893526:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efa0fe0a/0x4776e02a9acf62bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.893556:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481002.894511:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481002.894520:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efa0fe0a/0x4776e02a9acf62bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.894532:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481002.894536:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa0fe0a/0x4776e02a9acf62bc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.894554:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efa0fe0a/0x4776e02a9acf62bc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.894573:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efa0fe0a/0x4776e02a9acf62bc lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.894594:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efa0fe0a/0x4776e02a9acf62bc lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.894760:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.894763:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.894765:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481002.895569:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.895578:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf62c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.895592:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.895595:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.895600:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf62c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.895610:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf62c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.895619:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf62c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.895626:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf62c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.895638:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481002.895739:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481002.895745:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf62c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.895754:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481002.895758:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf62c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.895766:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf62c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.896179:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf62c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.896190:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf62c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.896222:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.896225:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.896227:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481002.897829:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.897842:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf637f8f/0x4776e02a9acf62ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.897863:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.897866:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.897872:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bf637f8f/0x4776e02a9acf62ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.897895:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bf637f8f/0x4776e02a9acf62ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.897906:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bf637f8f/0x4776e02a9acf62ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.897920:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bf637f8f/0x4776e02a9acf62ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.897957:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1782481002.899011:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.899019:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c444042/0x4776e02a9acf62d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.899058:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.899062:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.899068:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008c444042/0x4776e02a9acf62d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.899079:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008c444042/0x4776e02a9acf62d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.899100:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008c444042/0x4776e02a9acf62d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.899108:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008c444042/0x4776e02a9acf62d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.899126:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:3.0:1782481002.899689:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.899696:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f2f11e5/0x4776e02a9acf62d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.899705:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.899709:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.899713:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008f2f11e5/0x4776e02a9acf62d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.899723:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008f2f11e5/0x4776e02a9acf62d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.899732:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008f2f11e5/0x4776e02a9acf62d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.899739:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008f2f11e5/0x4776e02a9acf62d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.899761:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:3.0:1782481002.900228:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.900236:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bedc79cb/0x4776e02a9acf62df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.900245:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.900248:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.900253:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000bedc79cb/0x4776e02a9acf62df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.900262:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000bedc79cb/0x4776e02a9acf62df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.900270:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000bedc79cb/0x4776e02a9acf62df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.900277:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000bedc79cb/0x4776e02a9acf62df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.900287:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:3.0:1782481002.900769:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.900776:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e20352c/0x4776e02a9acf62e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.900785:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.900795:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.900799:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e20352c/0x4776e02a9acf62e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.900809:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e20352c/0x4776e02a9acf62e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.900817:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e20352c/0x4776e02a9acf62e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.900823:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e20352c/0x4776e02a9acf62e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.900833:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00010000:00010000:1.0:1782481002.905086:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1782481002.905101:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bf637f8f/0x4776e02a9acf62ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905117:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058a00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481002.905123:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf637f8f/0x4776e02a9acf62ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905134:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bf637f8f/0x4776e02a9acf62ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905156:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bf637f8f/0x4776e02a9acf62ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905162:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bf637f8f/0x4776e02a9acf62ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905188:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1782481002.905192:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008c444042/0x4776e02a9acf62d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905207:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481002.905211:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008c444042/0x4776e02a9acf62d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905219:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008c444042/0x4776e02a9acf62d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905251:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008c444042/0x4776e02a9acf62d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905259:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008c444042/0x4776e02a9acf62d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905277:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1782481002.905281:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008f2f11e5/0x4776e02a9acf62d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905287:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481002.905291:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008f2f11e5/0x4776e02a9acf62d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905299:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008f2f11e5/0x4776e02a9acf62d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905308:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008f2f11e5/0x4776e02a9acf62d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905314:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008f2f11e5/0x4776e02a9acf62d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905326:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782481002.905329:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000bedc79cb/0x4776e02a9acf62df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905342:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059c00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481002.905345:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000bedc79cb/0x4776e02a9acf62df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905353:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000bedc79cb/0x4776e02a9acf62df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905363:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000bedc79cb/0x4776e02a9acf62df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905369:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000bedc79cb/0x4776e02a9acf62df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905383:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481002.905386:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e20352c/0x4776e02a9acf62e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905393:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058c00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481002.905395:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e20352c/0x4776e02a9acf62e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905402:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e20352c/0x4776e02a9acf62e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905410:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e20352c/0x4776e02a9acf62e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905423:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e20352c/0x4776e02a9acf62e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.905438:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.905440:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.905441:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.905449:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1782481002.909568:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1782481002.909582:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ad6be1b/0x4776e02a9acf62ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.909598:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.909602:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.909609:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000007ad6be1b/0x4776e02a9acf62ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.909624:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000007ad6be1b/0x4776e02a9acf62ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.909635:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000007ad6be1b/0x4776e02a9acf62ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.909650:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000007ad6be1b/0x4776e02a9acf62ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.909705:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481002.910429:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481002.910439:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000007ad6be1b/0x4776e02a9acf62ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.910451:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481002.910457:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000007ad6be1b/0x4776e02a9acf62ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.910469:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000007ad6be1b/0x4776e02a9acf62ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.910490:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000007ad6be1b/0x4776e02a9acf62ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782481002.910496:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.910499:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000007ad6be1b/0x4776e02a9acf62ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.910504:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf62f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.910518:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=533s v=(0 0) 00010000:00010000:3.0:1782481002.910522:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481002.910527:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf62f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.910527:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.910531:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.910540:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf62f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.910541:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.910551:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf62f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.910558:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf62f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.910583:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1782481002.910643:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481002.910652:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf62f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481002.910680:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481002.910684:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf62f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481002.910706:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf62f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481002.910721:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf62f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481002.910730:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000029a8dee/0x4776e02a9acf62f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481002.910748:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481002.910751:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481002.910754:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481002.913134:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.913145:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf62fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.913159:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.913164:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.913169:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf62fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.913181:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf62fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.913192:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf62fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.913405:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf62fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.913434:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782481002.914186:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.914195:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de2ef186/0x4776e02a9acf6302 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.914216:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.914220:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.914225:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de2ef186/0x4776e02a9acf6302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.914249:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de2ef186/0x4776e02a9acf6302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.914259:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de2ef186/0x4776e02a9acf6302 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.914267:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de2ef186/0x4776e02a9acf6302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.914293:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782481002.914359:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481002.914368:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf62fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.914392:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ee00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.914397:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf62fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.914415:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf62fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.914440:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf62fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.914448:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006e8c29ed/0x4776e02a9acf62fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.914478:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.914481:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de2ef186/0x4776e02a9acf6302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.914488:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55f400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.914491:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de2ef186/0x4776e02a9acf6302 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.914503:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de2ef186/0x4776e02a9acf6302 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.914514:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de2ef186/0x4776e02a9acf6302 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.914528:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de2ef186/0x4776e02a9acf6302 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.914550:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.914552:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.914554:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481002.914732:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.914738:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002505c814/0x4776e02a9acf6309 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.914746:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.914749:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.914754:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002505c814/0x4776e02a9acf6309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.914762:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002505c814/0x4776e02a9acf6309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.914769:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002505c814/0x4776e02a9acf6309 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.916498:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.917565:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002505c814/0x4776e02a9acf6309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.917599:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782481002.919837:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.919852:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002505c814/0x4776e02a9acf6309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.919868:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.919873:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002505c814/0x4776e02a9acf6309 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.919884:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002505c814/0x4776e02a9acf6309 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.919907:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002505c814/0x4776e02a9acf6309 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.919916:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002505c814/0x4776e02a9acf6309 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.919938:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.919940:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.919954:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481002.920450:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.920459:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf6310 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.920471:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.920476:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.920482:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf6310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.920494:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf6310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.920503:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf6310 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.920510:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf6310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.920759:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782481002.924188:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.924210:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006211a737/0x4776e02a9acf6317 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.924234:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.924239:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.924244:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000006211a737/0x4776e02a9acf6317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.924259:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000006211a737/0x4776e02a9acf6317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.924270:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000006211a737/0x4776e02a9acf6317 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.924277:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000006211a737/0x4776e02a9acf6317 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.931153:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481002.931168:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf6310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.931183:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ea00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.931188:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf6310 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.931208:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf6310 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.931231:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf6310 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.931240:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000dfdc65ff/0x4776e02a9acf6310 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.931262:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.931266:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000006211a737/0x4776e02a9acf6317 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.931272:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55f800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.931275:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000006211a737/0x4776e02a9acf6317 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.931283:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000006211a737/0x4776e02a9acf6317 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.931306:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000006211a737/0x4776e02a9acf6317 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.931313:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.931315:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.931317:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:0.0:1782481002.931465:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00010000:00010000:1.0:1782481002.933170:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782481002.933184:0:14845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000006211a737/0x4776e02a9acf6317 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782481002.934235:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.934247:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b7797fb/0x4776e02a9acf631e lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.934265:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.934270:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.934277:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008b7797fb/0x4776e02a9acf631e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.934303:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008b7797fb/0x4776e02a9acf631e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.934313:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008b7797fb/0x4776e02a9acf631e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.934321:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008b7797fb/0x4776e02a9acf631e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.934341:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782481002.934921:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.934929:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008b7797fb/0x4776e02a9acf631e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.934937:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55f000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.934941:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7797fb/0x4776e02a9acf631e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.934951:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008b7797fb/0x4776e02a9acf631e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.934967:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008b7797fb/0x4776e02a9acf631e lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.934973:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008b7797fb/0x4776e02a9acf631e lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.934990:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.934992:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.934993:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.935008:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481002.938029:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.938188:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e226b63/0x4776e02a9acf6325 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.938216:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.938221:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.938229:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000005e226b63/0x4776e02a9acf6325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.938243:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000005e226b63/0x4776e02a9acf6325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.938254:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000005e226b63/0x4776e02a9acf6325 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.938273:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000005e226b63/0x4776e02a9acf6325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.939084:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782481002.939729:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.939738:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023ef35eb/0x4776e02a9acf632c lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.939752:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.939756:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.939761:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000023ef35eb/0x4776e02a9acf632c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.939772:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000023ef35eb/0x4776e02a9acf632c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.939780:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000023ef35eb/0x4776e02a9acf632c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.939787:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000023ef35eb/0x4776e02a9acf632c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.941442:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481002.941454:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000005e226b63/0x4776e02a9acf6325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.941468:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55fe00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.941473:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000005e226b63/0x4776e02a9acf6325 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.941484:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000005e226b63/0x4776e02a9acf6325 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.941505:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000005e226b63/0x4776e02a9acf6325 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.941512:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000005e226b63/0x4776e02a9acf6325 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.941532:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.941536:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000023ef35eb/0x4776e02a9acf632c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.941550:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.941554:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000023ef35eb/0x4776e02a9acf632c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.941561:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000023ef35eb/0x4776e02a9acf632c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.941585:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000023ef35eb/0x4776e02a9acf632c lrc: 2/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.941592:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.941594:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.941596:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481002.941651:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:1.0:1782481002.941674:0:14845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000023ef35eb/0x4776e02a9acf632c lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782481002.942578:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.942586:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf6333 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.942597:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.942601:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.942607:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf6333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.942620:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf6333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.942628:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf6333 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.942636:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf6333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.942652:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782481002.943322:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.943331:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001247af54/0x4776e02a9acf633a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.943341:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.943344:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.943358:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001247af54/0x4776e02a9acf633a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.943368:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001247af54/0x4776e02a9acf633a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.943377:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001247af54/0x4776e02a9acf633a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.943385:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001247af54/0x4776e02a9acf633a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.943394:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1782481002.944081:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481002.944089:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf6333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944098:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.944103:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf6333 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944111:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf6333 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944126:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf6333 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944133:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ba961e9f/0x4776e02a9acf6333 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944153:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.944156:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001247af54/0x4776e02a9acf633a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944174:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55ec00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.944177:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001247af54/0x4776e02a9acf633a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944185:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001247af54/0x4776e02a9acf633a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944196:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001247af54/0x4776e02a9acf633a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944212:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001247af54/0x4776e02a9acf633a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944226:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.944228:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.944230:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.944237:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481002.944435:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481002.944443:0:14845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf6341 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.944453:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=533s v=(0 0) 00010000:00010000:1.0:1782481002.944457:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481002.944462:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf6341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.944471:0:14845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf6341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.944480:0:14845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf6341 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.944501:0:14845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf6341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481002.944527:0:14845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1782481002.944755:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481002.944760:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf6341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.944767:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481002.944770:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf6341 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1782481002.945033:0:14845:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:6 00010000:00010000:3.0:1782481002.945113:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf6341 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.945135:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf6341 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.945142:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c3fce0d8/0x4776e02a9acf6341 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481002.945159:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.945160:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481002.945162:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481002.945449:0:14845:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14229:x1869066388212992:12345-0@lo:5:osp-pre-0-0.0 Request processed in 93328us (93443us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481002.945464:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1782481002.945595:0:14229:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72a00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14229:1869066388212992:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1782481002.945612:0:14229:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x6:0x0] 00000100:00100000:2.0:1782481002.945689:0:14229:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14229:1869066388213120:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1782481002.945726:0:14229:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481002.945762:0:14229:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d25a4b40 going to sleep for 11 seconds 00000100:00100000:1.0:1782481002.946063:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388213120 00000100:00100000:1.0:1782481002.946071:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388213120 00000100:00100000:1.0:1782481002.946126:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1782481002.946135:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14229:x1869066388213120:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:1.0:1782481002.946173:0:14842:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:1.0:1782481002.952960:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fe300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14229:x1869066388213120:12345-0@lo:5:osp-pre-0-0.0 Request processed in 6818us (7225us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1782481002.952974:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782481002.953310:0:14229:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14229:1869066388213120:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1782481002.953326:0:14229:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1782481003.172354:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1782481004.093827:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1782481004.093846:0:6632:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00010000:00010000:3.0:1782481004.191427:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481005.216878:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481006.238800:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481007.262971:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782481008.033794:0:13805:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782481008.033800:0:13805:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782481008.033804:0:13805:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782481008.033812:0:13805:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 533 00000100:00080000:0.0:1782481008.033818:0:13805:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:0.0:1782481008.033825:0:13805:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d7c77ca000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1782481008.033848:0:13805:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7ff0b3b80 x1869066388213504/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782481008.033926:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388213376:0@lo:400:kworker.0 00000100:00100000:0.0:1782481008.034005:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481008.034071:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782481008.034077:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388213248:0@lo:400:kworker.0 00000100:00100000:0.0:1782481008.034107:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481008.034158:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388213504:0@lo:8:kworker.0 00000100:00100000:0.0:1782481008.034183:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481008.034388:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388213632:0@lo:400:kworker.0 00000100:00100000:0.0:1782481008.034422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481008.034448:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782481008.034454:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388213760:0@lo:400:kworker.0 00000100:00100000:0.0:1782481008.034476:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481008.034506:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388213248 00000100:00100000:0.0:1782481008.034514:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388213248 00000100:00100000:0.0:1782481008.034560:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782481008.034570:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:3313:x1869066388213248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481008.034617:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:3313:x1869066388213248:12345-0@lo:400:kworker.0 Request processed in 48us (508us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481008.034624:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1782481008.034695:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388213376 00000100:00100000:0.0:1782481008.034699:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388213376 00000100:00100000:0.0:1782481008.034735:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388213504 00000100:00100000:0.0:1782481008.034738:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388213504 00000100:00100000:0.0:1782481008.034751:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782481008.034757:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388213376:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481008.034797:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388213376:12345-0@lo:400:kworker.0 Request processed in 39us (792us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481008.034803:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1782481008.034815:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782481008.034819:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1869066388213504:12345-0@lo:8:kworker.0 00010000:00020000:0.0:1782481008.034834:0:14844:0:(ldlm_lib.c:1179:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1782481008.035053:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388213632 00000100:00100000:3.0:1782481008.035058:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388213632 00000100:00100000:3.0:1782481008.035086:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388213760 00000100:00100000:3.0:1782481008.035090:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388213760 00000100:00100000:3.0:1782481008.035106:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782481008.035125:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388213632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481008.035165:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388213632:12345-0@lo:400:kworker.0 Request processed in 42us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481008.035173:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1782481008.035186:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782481008.035193:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388213760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481008.035232:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388213760:12345-0@lo:400:kworker.0 Request processed in 39us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481008.035245:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:3.0:1782481008.035288:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b1c00 x1869066388213760/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481008.035301:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388213760:0@lo:400:kworker.0 00010000:00080000:3.0:1782481008.035308:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b2a00 x1869066388213632/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481024 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481008.035314:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388213632:0@lo:400:kworker.0 00000100:00100000:1.0:1782481008.038749:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388213248:0@lo:400:kworker.0 00000100:00100000:1.0:1782481008.038774:0:3313:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:1.0:1782481008.038791:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388213376:0@lo:400:kworker.0 00000100:00100000:1.0:1782481008.047101:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388213888:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782481008.047195:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481008.047280:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388213888 00000100:00100000:1.0:1782481008.047288:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388213888 00000100:00100000:1.0:1782481008.047345:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782481008.047365:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388213888:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782481008.047411:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782481008.047458:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e77100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388213888:12345-0@lo:13:osp-pre-0-0.0 Request processed in 94us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481008.047465:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782481008.047513:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388213888:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1782481008.047995:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1782481008.048002:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782481008.061646:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1869066388213504:12345-0@lo:8:kworker.0 Request processed in 26815us (27452us total) trans 0 rc -19/-19 00000100:00100000:0.0:1782481008.061679:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1782481008.061743:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1782481008.061750:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:0.0:1782481008.061754:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388213504:0@lo:8:kworker.0 00010000:00010000:0.0:1782481008.288622:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1782481008.875083:0:15515:0:(obd_mount.c:914:lmd_print()) mount data: 00000020:01000004:2.0:1782481008.875087:0:15515:0:(obd_mount.c:917:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1782481008.875235:0:15515:0:(super25.c:130:lustre_fill_super()) VFS Op: sb ffff91d7df543000 00000020:01000004:2.0:1782481008.875252:0:15515:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1782481008.875266:0:15515:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1782481008.875280:0:15515:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff91d7c2d04d40) 00000020:00000080:2.0:1782481008.875299:0:15515:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1782481008.895076:0:15515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1782481008.895427:0:15515:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1782481008.896489:0:15515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1782481008.896761:0:15515:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1782481008.897128:0:15515:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1782481008.897546:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 511: rc = 0 00100000:10000000:2.0:1782481008.897644:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 511: rc = 0 00100000:10000000:2.0:1782481008.897850:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 511: rc = 0 00100000:10000000:2.0:1782481008.898572:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1782481008.898998:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1782481008.899253:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 769: rc = 0 00100000:10000000:2.0:1782481008.899580:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 769: rc = 0 00100000:10000000:2.0:1782481008.900114:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 769: rc = 0 00100000:10000000:2.0:1782481008.900435:0:15515:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 769: rc = 0 00000020:00000080:2.0:1782481008.901051:0:15515:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1782481008.901062:0:15515:0:(osd_handler.c:1569:osd_obd_connect()) connect #0 00000020:00000080:2.0:1782481008.901072:0:15515:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4776e02a9acf634f 00000020:01000004:2.0:1782481008.901081:0:15515:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1782481008.901113:0:15515:0:(obd_mount.c:394:lustre_start_mgc()) MGC192.168.201.158@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1782481008.901117:0:15515:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.201.158@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1782481008.901123:0:15515:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1782481008.901142:0:15515:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1782481008.901145:0:15515:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.201.158@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1782481008.918531:0:15515:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.201.158@tcp ctxt 0 is initialized 00000020:01000004:3.0:1782481008.918573:0:15515:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.201.158@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1782481008.918577:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1782481008.918580:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782481008.918581:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782481008.918582:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782481008.918583:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782481008.918584:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782481008.918586:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782481008.918588:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782481008.918589:0:15515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782481008.918592:0:15515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1782481008.918594:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1782481008.918596:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782481008.918597:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782481008.918598:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782481008.918599:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782481008.918600:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782481008.918601:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782481008.918602:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782481008.918603:0:15515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1782481008.918633:0:15515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1782481008.918720:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214016:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1782481008.918799:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481008.918934:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782481008.919446:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388214016 00000100:00100000:1.0:1782481008.919456:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388214016 00000100:00100000:1.0:1782481008.919564:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1782481008.919575:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:15515:x1869066388214016:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1782481008.919610:0:14200:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1782481008.919615:0:14200:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1782481008.919620:0:14200:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1782481008.927217:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:15515:x1869066388214016:12345-0@lo:253:mount.lustre.0 Request processed in 7636us (8408us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481008.927231:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1782481008.927326:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214016:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1782481008.927340:0:15515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1782481008.927343:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1782481008.927345:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1782481008.927346:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1782481008.927348:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1782481008.927349:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1782481008.927350:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1782481008.927417:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1782481008.927419:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1782481008.927421:0:15515:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1782481008.927439:0:15515:0:(tgt_mount.c:101:server_register_mount()) register mount ffff91d7df543000 from lustre-OST0001 10000000:01000000:3.0:1782481008.927464:0:15515:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1782481008.927467:0:15515:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782481008.927474:0:15515:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff91d7ff0c19c0 local copy 00010000:00010000:3.0:1782481008.927485:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6103 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481008.927722:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214144:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481008.927757:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481008.927789:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96540 going to sleep for 11 seconds 00000100:00100000:2.0:1782481008.927885:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388214144 00000100:00100000:2.0:1782481008.927891:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388214144 00000100:00100000:2.0:1782481008.927923:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:2.0:1782481008.927930:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:15515:x1869066388214144:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1782481008.928133:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:15515:x1869066388214144:12345-0@lo:501:mount.lustre.0 Request processed in 203us (375us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782481008.928140:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1782481008.928398:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214144:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1782481008.928412:0:15515:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.201.158@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1782481008.928544:0:15515:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.201.158@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1782481008.928551:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6103 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.928561:0:15515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779a000/0x4776e02a9acf60fc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6103 expref: -99 pid: 14189 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481008.928594:0:15515:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff91d7df543000 10000000:01000000:3.0:1782481008.928599:0:15515:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1782481008.928604:0:15515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1782481008.928606:0:15515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782481008.928610:0:15515:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:3.0:1782481008.928613:0:15515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:3.0:1782481008.928636:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a400/0x4776e02a9acf6356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.928644:0:15515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779a400/0x4776e02a9acf6356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.928653:0:15515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779a400/0x4776e02a9acf6356 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481008.928692:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214272:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782481008.928716:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481008.928740:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96540 going to sleep for 11 seconds 00000100:00100000:2.0:1782481008.929019:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388214272 00000100:00100000:2.0:1782481008.929025:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388214272 00000100:00100000:2.0:1782481008.929065:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1782481008.929073:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:15515:x1869066388214272:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1782481008.929085:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481008.929109:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2da00/0x4776e02a9acf635d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6356 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481008.929133:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2da00/0x4776e02a9acf635d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6356 expref: 17 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481008.929143:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2da00/0x4776e02a9acf635d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6356 expref: 17 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481008.929152:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2da00, rc 0) 00000100:00100000:2.0:1782481008.929194:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:15515:x1869066388214272:12345-0@lo:101:mount.lustre.0 Request processed in 122us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481008.929200:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1782481008.929276:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214272:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481008.929291:0:15515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779a400/0x4776e02a9acf6356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf635d expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481008.929301:0:15515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779a400/0x4776e02a9acf6356 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf635d expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782481008.930243:0:15515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1782481008.932264:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1782481008.933024:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1782481008.933085:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1782481008.933132:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1782481008.933186:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1782481008.933222:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1782481008.933271:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:0.0:1782481008.933340:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:0.0:1782481008.933348:0:15515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:0.0:1782481008.934087:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481008.934165:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481008.934281:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dcba19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782481008.934332:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388214400 00000100:00100000:3.0:1782481008.934339:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388214400 00000100:00100000:3.0:1782481008.934492:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1782481008.934502:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:15515:x1869066388214400:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481008.935057:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:15515:x1869066388214400:12345-0@lo:501:mount.lustre.0 Request processed in 555us (890us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481008.935064:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1782481008.935156:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214400:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481008.935195:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214528:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1782481008.935232:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481008.935693:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dcba19c0 going to sleep for 11 seconds 00000100:00100000:2.0:1782481008.935760:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388214528 00000100:00100000:2.0:1782481008.935765:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388214528 00000100:00100000:2.0:1782481008.935795:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1782481008.935802:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:15515:x1869066388214528:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782481008.936341:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:15515:x1869066388214528:12345-0@lo:503:mount.lustre.0 Request processed in 537us (1106us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481008.936351:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1782481008.936558:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214528:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1782481008.937342:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1782481008.937594:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214656:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481008.937653:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481008.937835:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dcba19c0 going to sleep for 11 seconds 00000100:00100000:1.0:1782481008.938071:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388214656 00000100:00100000:1.0:1782481008.938078:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388214656 00000100:00100000:1.0:1782481008.938136:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1782481008.938145:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:15515:x1869066388214656:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481008.938527:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:15515:x1869066388214656:12345-0@lo:502:mount.lustre.0 Request processed in 383us (873us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481008.938535:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1782481008.938630:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214656:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782481008.939193:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:0.0:1782481008.939249:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:0.0:1782481008.939287:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:0.0:1782481008.939332:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:0.0:1782481008.939452:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:0.0:1782481008.939487:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:0.0:1782481008.939534:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:0.0:1782481008.939569:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:0.0:1782481008.939618:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:0.0:1782481008.940054:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214784:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481008.940123:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481008.940215:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7dcba19c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782481008.940253:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388214784 00000100:00100000:3.0:1782481008.940260:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388214784 00000100:00100000:3.0:1782481008.940346:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1782481008.940363:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:15515:x1869066388214784:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481008.940538:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:15515:x1869066388214784:12345-0@lo:502:mount.lustre.0 Request processed in 185us (415us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481008.940545:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1782481008.940611:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214784:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1782481008.940714:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:0.0:1782481008.940724:0:15515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1782481008.941893:0:15516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1782481008.941902:0:15516:0:(obd_mount.c:952:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1782481008.941909:0:15516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481008.941912:0:15516:0:(obd_config.c:1561:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1782481008.941917:0:15516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1782481008.941933:0:15516:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff91d7ecfa8000) 00000020:00000080:0.0:1782481008.941968:0:15516:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1782481008.941974:0:15516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1782481008.942037:0:15516:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d7df543000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1782481008.942044:0:15516:0:(osd_handler.c:1569:osd_obd_connect()) connect #1 00000020:00000080:0.0:1782481008.942051:0:15516:0:(genops.c:1406:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x4776e02a9acf636b 00010000:00010000:0.0:1782481008.948744:0:15516:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:0.0:1782481008.949430:0:15516:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:0.0:1782481008.951924:0:15516:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1782481008.963757:0:15516:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1782481008.963775:0:15516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481008.963783:0:15516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481008.963785:0:15516:0:(obd_config.c:1561:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1782481008.963790:0:15516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481008.963795:0:15516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481008.963797:0:15516:0:(obd_config.c:1561:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:0.0:1782481008.963801:0:15516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1782481008.963802:0:15516:0:(obd_config.c:1535:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1782481008.963805:0:15516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481008.963808:0:15516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481008.963809:0:15516:0:(obd_config.c:1561:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:0.0:1782481008.963812:0:15516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1782481008.963813:0:15516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481008.963821:0:15516:0:(obd_config.c:1561:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1782481008.963825:0:15516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1782481008.964073:0:15516:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1782481008.964078:0:15516:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1782481008.964079:0:15516:0:(obd_config.c:1561:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1782481008.964084:0:15516:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1782481008.968723:0:15515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1782481008.968771:0:15515:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1782481008.968834:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779a400/0x4776e02a9acf6356 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf635d expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.968857:0:15515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779a400/0x4776e02a9acf6356 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf635d expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481008.968866:0:15515:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7df543000 from 1 10000000:01000000:3.0:1782481008.968869:0:15515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1782481008.968914:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.968923:0:15515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.968933:0:15515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481008.968964:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214912:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782481008.969026:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481008.969072:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96d80 going to sleep for 11 seconds 00000100:00100000:1.0:1782481008.969393:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388214912 00000100:00100000:1.0:1782481008.969400:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388214912 00000100:00100000:1.0:1782481008.969457:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782481008.969467:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:15515:x1869066388214912:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481008.969481:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481008.969500:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d802059c00/0x4776e02a9acf6379 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6372 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481008.969522:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d802059c00/0x4776e02a9acf6379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6372 expref: 18 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481008.969532:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d802059c00/0x4776e02a9acf6379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6372 expref: 18 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481008.969540:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d802059c00, rc 0) 00000100:00100000:1.0:1782481008.969584:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388214912:12345-0@lo:101:mount.lustre.0 Request processed in 118us (557us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481008.969592:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1782481008.969641:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe72680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388214912:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1782481008.969654:0:15515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481008.969683:0:15515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1782481008.970203:0:15515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1782481008.970831:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1782481008.971056:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1782481008.971112:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1782481008.971175:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1782481008.971182:0:15515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1782481008.971251:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481008.971302:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481008.971335:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d2589e40 going to sleep for 11 seconds 00000100:00100000:3.0:1782481008.971683:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388215040 00000100:00100000:3.0:1782481008.971691:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388215040 00000100:00100000:3.0:1782481008.971735:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1782481008.971745:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388215040:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481008.971963:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388215040:12345-0@lo:501:mount.lustre.0 Request processed in 220us (659us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481008.971971:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1782481008.974493:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215040:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1782481008.974554:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215168:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481008.974622:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481008.974690:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388215168 00000100:00100000:1.0:1782481008.974696:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388215168 00000100:00100000:1.0:1782481008.974742:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782481008.974753:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388215168:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1782481008.976314:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef352c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388215168:12345-0@lo:503:mount.lustre.0 Request processed in 1556us (1685us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481008.976327:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1782481008.976515:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d2589e40 going to sleep for 11 seconds 00000100:00100000:1.0:1782481008.976538:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215168:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1782481008.977514:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1782481008.977592:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215296:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481008.977765:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481008.977793:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d2589e40 going to sleep for 11 seconds 00000100:00100000:2.0:1782481008.978045:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388215296 00000100:00100000:2.0:1782481008.978053:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388215296 00000100:00100000:2.0:1782481008.978136:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1782481008.978146:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388215296:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782481008.978384:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef353050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388215296:12345-0@lo:502:mount.lustre.0 Request processed in 239us (724us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481008.978391:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1782481008.978476:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215296:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481008.978727:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1782481008.978777:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1782481008.978825:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1782481008.978886:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1782481008.978923:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1782481008.979154:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1782481008.979193:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1782481008.979225:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1782481008.979260:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215424:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1782481008.979315:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481008.979914:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7d2589e40 going to sleep for 11 seconds 00000100:00100000:0.0:1782481008.980166:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388215424 00000100:00100000:0.0:1782481008.980174:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388215424 00000100:00100000:0.0:1782481008.980213:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1782481008.980222:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388215424:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1782481008.980435:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef351c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388215424:12345-0@lo:502:mount.lustre.0 Request processed in 214us (1119us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481008.980443:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1782481008.980563:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215424:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1782481008.980695:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1782481008.980708:0:15515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:1.0:1782481008.982107:0:15520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481008.982120:0:15520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481008.982122:0:15520:0:(obd_config.c:1561:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1782481008.982130:0:15520:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d7df543000 00000020:00000080:1.0:1782481008.982132:0:15520:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481008.982140:0:15520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481008.982142:0:15520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481008.982143:0:15520:0:(obd_config.c:1561:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1782481008.982146:0:15520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481008.982148:0:15520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481008.982150:0:15520:0:(obd_config.c:1561:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1782481008.982153:0:15520:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: general-ffff91d7df543000 00000020:00000080:1.0:1782481008.982155:0:15520:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481008.982220:0:15520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481008.982224:0:15520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481008.982226:0:15520:0:(obd_config.c:1561:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1782481008.982228:0:15520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1782481008.982231:0:15520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481008.982232:0:15520:0:(obd_config.c:1561:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1782481008.982236:0:15520:0:(obd_config.c:2005:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff91d7df543000 00000020:00000080:1.0:1782481008.982238:0:15520:0:(obd_config.c:1470:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1782481008.982274:0:15520:0:(obd_config.c:1890:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1782481008.982277:0:15520:0:(obd_config.c:1470:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1782481008.982278:0:15520:0:(obd_config.c:1561:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1782481008.982281:0:15520:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:3.0:1782481008.986165:0:15515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1782481008.986205:0:15515:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1782481008.986229:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.986243:0:15515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481008.986299:0:15515:0:(mgc_request.c:1945:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1782481008.986303:0:15515:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff91d7df543000 10000000:01000000:3.0:1782481008.986306:0:15515:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff91d7df543000 10000000:01000000:3.0:1782481008.986310:0:15515:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1782481008.986316:0:15515:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-client-ffff91d7df543000 from 1 10000000:01000000:3.0:1782481008.986319:0:15515:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1782481008.987071:0:15515:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779ba00/0x4776e02a9acf6380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.987082:0:15515:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779ba00/0x4776e02a9acf6380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.987103:0:15515:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779ba00/0x4776e02a9acf6380 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481008.987132:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215552:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1782481008.987213:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481008.987260:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96240 going to sleep for 11 seconds 00000100:00100000:0.0:1782481008.988535:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388215552 00000100:00100000:0.0:1782481008.988547:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388215552 00000100:00100000:0.0:1782481008.988643:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1782481008.988652:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388215552:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1782481008.988683:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481008.988700:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297ae00/0x4776e02a9acf6387 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6380 expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481008.988729:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297ae00/0x4776e02a9acf6387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6380 expref: 19 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481008.988740:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297ae00/0x4776e02a9acf6387 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6380 expref: 19 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481008.988748:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297ae00, rc 0) 00000100:00100000:0.0:1782481008.988803:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef352050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:15515:x1869066388215552:12345-0@lo:101:mount.lustre.0 Request processed in 152us (1590us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481008.988818:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1782481008.990527:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215552:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1782481008.990554:0:15515:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779ba00/0x4776e02a9acf6380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6387 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481008.990565:0:15515:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779ba00/0x4776e02a9acf6380 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf6387 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1782481008.993766:0:15515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:3.0:1782481008.994827:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1782481008.995636:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1782481008.995710:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1782481008.995746:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1782481008.995796:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1782481008.995832:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1782481008.997135:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1782481008.997184:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1782481008.997218:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1782481008.997265:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1782481008.997301:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1782481008.997332:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1782481008.998757:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1782481008.998814:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1782481009.001884:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1782481009.002228:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1782481009.002291:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1782481009.002327:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1782481009.002376:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1782481009.002413:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1782481009.002444:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1782481009.002503:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1782481009.002533:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1782481009.002563:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1782481009.002611:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1782481009.002647:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1782481009.002710:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1782481009.002762:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1782481009.002798:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1782481009.002832:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1782481009.006390:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:3.0:1782481009.006447:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:3.0:1782481009.006508:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:3.0:1782481009.006545:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:3.0:1782481009.006599:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:3.0:1782481009.006633:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:3.0:1782481009.006722:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:3.0:1782481009.006761:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:3.0:1782481009.006881:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:3.0:1782481009.006889:0:15515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:3.0:1782481009.009115:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481009.009184:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481009.009729:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96240 going to sleep for 11 seconds 00000100:00100000:0.0:1782481009.018918:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388215680 00000100:00100000:0.0:1782481009.018933:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388215680 00000100:00100000:0.0:1782481009.019003:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1782481009.019012:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:15515:x1869066388215680:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1782481009.019338:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef350450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:15515:x1869066388215680:12345-0@lo:501:mount.lustre.0 Request processed in 326us (10153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481009.019346:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1782481009.021484:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215680:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1782481009.021549:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215808:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1782481009.021621:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481009.021655:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96240 going to sleep for 11 seconds 00000100:00100000:2.0:1782481009.022474:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388215808 00000100:00100000:2.0:1782481009.022484:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388215808 00000100:00100000:2.0:1782481009.022553:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1782481009.022564:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:15515:x1869066388215808:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1782481009.023047:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef350850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:15515:x1869066388215808:12345-0@lo:503:mount.lustre.0 Request processed in 482us (1423us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481009.023057:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1782481009.025261:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215808:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1782481009.028401:0:15515:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1782481009.028506:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215936:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481009.028590:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481009.028624:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96240 going to sleep for 11 seconds 00000100:00100000:2.0:1782481009.033218:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388215936 00000100:00100000:2.0:1782481009.033234:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388215936 00000100:00100000:2.0:1782481009.033299:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1782481009.033311:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:15515:x1869066388215936:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1782481009.033752:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef350c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:15515:x1869066388215936:12345-0@lo:502:mount.lustre.0 Request processed in 442us (5160us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481009.033761:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1782481009.035702:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388215936:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782481009.036056:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1782481009.036125:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1782481009.036155:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1782481009.036197:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1782481009.036238:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1782481009.036300:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1782481009.036342:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1782481009.036371:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1782481009.036408:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1782481009.036443:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1782481009.036471:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1782481009.036508:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1782481009.036536:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1782481009.036563:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1782481009.036609:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1782481009.036641:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1782481009.036698:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1782481009.036753:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1782481009.036787:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1782481009.036818:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1782481009.036870:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1782481009.036903:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1782481009.036952:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1782481009.037003:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1782481009.037036:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1782481009.037067:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1782481009.037132:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1782481009.037170:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1782481009.037219:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1782481009.037270:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1782481009.037316:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1782481009.037354:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1782481009.037386:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1782481009.037431:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1782481009.037472:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1782481009.037520:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1782481009.037551:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1782481009.037584:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1782481009.037648:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1782481009.037710:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1782481009.037776:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388216064:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481009.037855:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481009.037907:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388216064 00000100:00100000:3.0:1782481009.037914:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388216064 00000100:00100000:3.0:1782481009.037964:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782481009.037975:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:15515:x1869066388216064:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1782481009.038200:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef353c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:15515:x1869066388216064:12345-0@lo:502:mount.lustre.0 Request processed in 226us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481009.038209:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1782481009.038271:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96240 going to sleep for 11 seconds 00000100:00100000:3.0:1782481009.038293:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388216064:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1782481009.038362:0:15515:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1782481009.038371:0:15515:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1782481009.047154:0:15525:0:(obd_mount.c:221:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1782481009.047178:0:15525:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff91d7f4cc19c0) 00000020:00000080:1.0:1782481009.047211:0:15525:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1782481009.047418:0:15525:0:(tgt_mount.c:153:server_get_mount()) get mount ffff91d7df543000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782481009.047424:0:15525:0:(tgt_mount.c:187:server_put_mount()) put mount ffff91d7df543000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1782481009.047428:0:15525:0:(obd_mount.c:701:lustre_put_lsi()) put ffff91d7df543000 3 00010000:00080000:1.0:1782481009.047462:0:15525:0:(ldlm_lib.c:102:import_set_conn()) imp ffff91d6c3a2c000@lustre-MDT0000-lwp-OST0001: add connection 192.168.201.158@tcp at head 00010000:00010000:1.0:1782481009.049006:0:15525:0:(ldlm_pool.c:925:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:1.0:1782481009.049118:0:15525:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1782481009.049155:0:15525:0:(lwp_dev.c:497:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1782481009.049169:0:15525:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x4776e02a9acf6395 00000100:00080000:1.0:1782481009.049182:0:15525:0:(import.c:512:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1782481009.049188:0:15525:0:(import.c:626:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff91d6c3a2c000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:1.0:1782481009.049231:0:15525:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d6c1e75c00 x1869066388216192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1782481009.049279:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1869066388216192:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1782481009.049349:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1782481009.049418:0:15525:0:(pinger.c:375:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1782481009.054791:0:36:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782481009.054798:0:36:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782481009.054802:0:36:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782481009.054811:0:36:0:(import.c:512:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 538 00000100:00080000:0.0:1782481009.054816:0:36:0:(import.c:591:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 20s 00000100:00080000:0.0:1782481009.054823:0:36:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d7c77ca000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1782481009.054858:0:36:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7ff0b1180 x1869066388216448/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782481009.054928:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388216704:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.055125:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.055169:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1782481009.055175:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388216576:0@lo:400:kworker.0 00000100:00100000:0.0:1782481009.055196:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481009.056026:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388216320:0@lo:400:kworker.0 00000100:00100000:1.0:1782481009.056064:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481009.056149:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388216320 00000100:00100000:1.0:1782481009.056157:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388216320 00000100:00100000:1.0:1782481009.056202:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782481009.056210:0:14845:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388216320:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481009.056263:0:14845:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e74380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388216320:12345-0@lo:400:kworker.0 Request processed in 53us (198us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481009.056271:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1782481009.056313:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388216320:0@lo:400:kworker.0 00000100:00100000:1.0:1782481009.056342:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388216448:0@lo:8:kworker.0 00000100:00100000:1.0:1782481009.056385:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481009.056413:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388216448 00000100:00100000:1.0:1782481009.056416:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388216448 00000100:00100000:1.0:1782481009.056433:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782481009.056437:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1869066388216448:12345-0@lo:8:kworker.0 00000100:00100000:1.0:1782481009.056483:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e76300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1869066388216448:12345-0@lo:8:kworker.0 Request processed in 43us (97us total) trans 0 rc -11/-11 00000100:00100000:1.0:1782481009.056489:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782481009.056511:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1782481009.056517:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1782481009.056521:0:3309:0:(import.c:1513:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1782481009.056524:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388216448:0@lo:8:kworker.0 00000100:00100000:3.0:1782481009.056601:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388216192 00000100:00100000:3.0:1782481009.056606:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388216192 00000100:00100000:3.0:1782481009.056622:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388216704 00000100:00100000:3.0:1782481009.056625:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388216704 00000100:00100000:3.0:1782481009.056678:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388216576 00000100:00100000:3.0:1782481009.056681:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388216576 00000100:00100000:3.0:1782481009.056697:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782481009.056703:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388216704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481009.056746:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388216704:12345-0@lo:400:kworker.0 Request processed in 43us (1621us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481009.056753:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1782481009.056765:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782481009.056771:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388216576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481009.056797:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1869066388216576:12345-0@lo:400:kworker.0 Request processed in 27us (1600us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481009.056803:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1782481009.056814:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782481009.056818:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1869066388216192:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1782481009.056833:0:14208:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 539 last 0 00000020:00000080:3.0:1782481009.059266:0:14208:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x4776e02a9acf639c 00000004:00100000:3.0:1782481009.059291:0:14208:0:(mdt_handler.c:7286:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1782481009.059335:0:14208:0:(import.c:65:import_set_state_nolock()) ffff91d7c7f52000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782481009.059428:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e75880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1869066388216192:12345-0@lo:38:llog_process_th.0 Request processed in 2606us (10077us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481009.059438:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1782481009.059769:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b1880 x1869066388216576/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481009.059785:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1869066388216576:0@lo:400:kworker.0 00010000:00080000:1.0:1782481009.059807:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d7ff0b1f80 x1869066388216704/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481025 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1782481009.059817:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388216704:0@lo:400:kworker.0 00010000:00080000:0.0:1782481009.062238:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff91d6c1e75c00 x1869066388216192/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1782481019 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481009.062253:0:3309:0:(client.c:3111:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1782481009.062272:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:0.0:1782481009.062281:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1782481009.062287:0:3309:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1782481009.062292:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d6c3a2c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1782481009.062299:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1869066388216192:0@lo:38:llog_process_th.0 00000040:00080000:2.0:1782481009.064215:0:15525:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:2.0:1782481009.068861:0:15515:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1782481009.068910:0:15515:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1782481009.068942:0:15515:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779ba00/0x4776e02a9acf6380 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6387 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481009.068955:0:15515:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779ba00/0x4776e02a9acf6380 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf6387 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1782481009.069011:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1782481009.069017:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782481009.069018:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481009.069019:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481009.069020:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481009.069021:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481009.069023:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782481009.069024:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481009.069025:0:15515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782481009.069029:0:15515:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:2.0:1782481009.069031:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1782481009.069032:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782481009.069033:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481009.069034:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481009.069035:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481009.069036:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481009.069036:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782481009.069037:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481009.069038:0:15515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1782481009.069061:0:15515:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1782481009.069079:0:15515:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388216832:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1782481009.069155:0:15515:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481009.069196:0:15515:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c50f9180 going to sleep for 11 seconds 00000100:00100000:0.0:1782481009.069653:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388216832 00000100:00100000:0.0:1782481009.069684:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388216832 00000100:00100000:0.0:1782481009.069802:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1782481009.069812:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:15515:x1869066388216832:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1782481009.069900:0:14200:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1782481009.069917:0:14200:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1782481009.101393:0:14200:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1782481009.101405:0:14200:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:0.0:1782481009.101429:0:14222:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1782481009.101433:0:14222:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1782481009.101454:0:14222:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481009.101472:0:14222:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf627d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6276 expref: 19 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481009.101482:0:14222:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481009.101519:0:14222:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf627d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf6276 expref: 19 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481009.101533:0:14222:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf627d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf6276 expref: 19 pid: 14202 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481009.101565:0:14222:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14222:1869066388216960:0@lo:104: 00000100:00100000:0.0:1782481009.101630:0:14222:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481009.101688:0:14222:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7fe9b9d80 going to sleep for 11 seconds 00000100:00100000:3.0:1782481009.101810:0:14191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388216960 00000100:00100000:3.0:1782481009.101817:0:14191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388216960 00000100:00100000:3.0:1782481009.101868:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782481009.101876:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+3:14222:x1869066388216960:12345-0@lo:104: 00010000:00010000:3.0:1782481009.101888:0:14191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.101953:0:14191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782481009.101959:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+3:14222:x1869066388216960:12345-0@lo:104: Request processed in 84us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481009.101966:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:3.0:1782481009.101985:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481009.101989:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.101996:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b400 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782481009.101999:0:14196:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102007:0:14196:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481009.102014:0:14196:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481009.102020:0:14196:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1782481009.102045:0:14196:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102052:0:14196:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481009.102068:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102074:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c779b400/0x4776e02a9acf6276 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf627d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102111:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481009.102112:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481009.102114:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481009.102132:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3312:1869066388217088:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481009.102158:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481009.102195:0:14192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388217088 00000100:00100000:3.0:1782481009.102198:0:14192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388217088 00010000:00010000:3.0:1782481009.102225:0:14192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf627d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf6276 expref: 20 pid: 14202 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481009.102244:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782481009.102249:0:14192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+20:3312:x1869066388217088:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481009.102258:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481009.102262:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf627d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf6276 expref: 20 pid: 14202 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102271:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf627d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf6276 expref: 20 pid: 14202 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102286:0:14192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102293:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1782481009.102304:0:14192:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006072188s 00010000:00010000:3.0:1782481009.102308:0:14192:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102323:0:14192:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102331:0:14192:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102337:0:14192:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102342:0:14192:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481009.102346:0:14192:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102353:0:14192:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102360:0:14192:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102368:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481009.102390:0:14192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe72300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+20:3312:x1869066388217088:12345-0@lo:103:ldlm_bl.0 Request processed in 141us (231us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481009.102396:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782481009.102424:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3312:1869066388217088:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481009.102445:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779b000/0x4776e02a9acf627d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf6276 expref: 19 pid: 14202 timeout: 639 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481009.102454:0:14222:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14222:1869066388216960:0@lo:104: 00010000:00010000:3.0:1782481009.102465:0:14222:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102478:0:14222:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102484:0:14222:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481009.102491:0:14222:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf63a3 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14222 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481009.111715:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef352450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:15515:x1869066388216832:12345-0@lo:253:mount.lustre.0 Request processed in 41840us (42495us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481009.111731:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1782481009.111833:0:15515:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fe680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:15515:1869066388216832:0@lo:253:mount.lustre.0 10000000:01000000:2.0:1782481009.111928:0:15515:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1782481009.111931:0:15515:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1782481009.111933:0:15515:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1782481009.111989:0:15515:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1782481009.111990:0:15515:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1782481009.111991:0:15515:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1782481009.111993:0:15515:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1782481009.111994:0:15515:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1782481009.111996:0:15515:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1782481009.111997:0:15515:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1782481009.112010:0:15515:0:(tgt_mount.c:2689:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1782481009.116292:0:15515:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1782481009.116464:0:15515:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1782481009.116626:0:15515:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1782481009.117190:0:15515:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1782481009.117361:0:15515:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1782481009.117560:0:15515:0:(osd_index.c:2102:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1782481009.118465:0:15515:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:0.0:1782481009.184086:0:15515:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1782481009.184106:0:15515:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1782481009.184138:0:15515:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1782481009.184196:0:15515:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.201.158@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1782481009.184215:0:15515:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1782481009.184244:0:15515:0:(super25.c:187:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:1.0:1782481009.312942:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481010.336155:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1782481010.398754:0:14204:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1782481010.398763:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log lustre-mdtir-ffff91d7fe76b000 from 8 10000000:01000000:3.0:1782481010.398768:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1782481010.398827:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779b000/0x4776e02a9acf63aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481010.398839:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d7c779b000/0x4776e02a9acf63aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481010.398855:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d7c779b000/0x4776e02a9acf63aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481010.398882:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388217216:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1782481010.398960:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481010.399003:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96240 going to sleep for 11 seconds 00000100:00100000:3.0:1782481010.399023:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388217216 00000100:00100000:3.0:1782481010.399030:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388217216 00000100:00100000:3.0:1782481010.399098:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782481010.399107:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:14204:x1869066388217216:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481010.399128:0:14202:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481010.399140:0:14202:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779b400/0x4776e02a9acf63b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf63aa expref: -99 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481010.399163:0:14202:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779b400/0x4776e02a9acf63b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf63aa expref: 19 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481010.399175:0:14202:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779b400/0x4776e02a9acf63b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf63aa expref: 19 pid: 14202 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481010.399183:0:14202:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779b400, rc 0) 00000100:00100000:3.0:1782481010.399220:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef353850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:14204:x1869066388217216:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 115us (260us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481010.399228:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1782481010.399278:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388217216:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481010.399292:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d7c779b000/0x4776e02a9acf63aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf63b1 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481010.399301:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d7c779b000/0x4776e02a9acf63aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf63b1 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481010.399350:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388217344:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1782481010.399379:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481010.399399:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7efe96240 going to sleep for 11 seconds 00000100:00100000:0.0:1782481010.400036:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388217344 00000100:00100000:0.0:1782481010.400042:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388217344 00000100:00100000:0.0:1782481010.400093:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1782481010.400101:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:14204:x1869066388217344:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1782481010.400120:0:14200:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1782481010.400139:0:14200:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1782481010.400143:0:14200:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:0.0:1782481010.400237:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef353450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:14204:x1869066388217344:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 136us (856us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481010.400244:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1782481010.400735:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388217344:0@lo:256:ll_cfg_requeue.0 10000000:01000000:3.0:1782481010.400804:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1782481010.400814:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d7c779b000/0x4776e02a9acf63aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf63b1 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481010.400830:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d7c779b000/0x4776e02a9acf63aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf63b1 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782481010.854216:0:14240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782481011.362024:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481012.382852:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481013.152895:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782481013.152917:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388217472:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782481013.152989:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481013.153103:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388217472 00000100:00100000:1.0:1782481013.153113:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388217472 00000100:00100000:1.0:1782481013.153177:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782481013.153200:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388217472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782481013.153237:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782481013.153290:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe72680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388217472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481013.153298:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1782481013.153345:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388217472:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782481013.153413:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1782481013.408105:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1782481014.179191:0:13805:0:(pinger.c:231:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1782481014.179199:0:13805:0:(pinger.c:239:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:0.0:1782481014.179203:0:13805:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1782481014.179216:0:13805:0:(import.c:626:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff91d7c77ca000 using connection 192.168.201.158@tcp/0@lo 00000100:00100000:0.0:1782481014.179238:0:13805:0:(import.c:828:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff91d7ff0b3b80 x1869066388217856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1782481014.179318:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388217600:0@lo:400:kworker.0 00000100:00100000:0.0:1782481014.179392:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481014.179437:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388218240:0@lo:400:kworker.0 00000100:00100000:0.0:1782481014.179464:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481014.179489:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782481014.179494:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388217728:0@lo:400:kworker.0 00000100:00100000:0.0:1782481014.179517:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481014.179545:0:3309:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388217856:0@lo:8:kworker.0 00000100:00100000:0.0:1782481014.179567:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481014.179592:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388217984:0@lo:400:kworker.0 00000100:00100000:0.0:1782481014.179612:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481014.179629:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782481014.179635:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388218112:0@lo:400:kworker.0 00000100:00100000:0.0:1782481014.179654:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481014.179700:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388217600 00000100:00100000:0.0:1782481014.179707:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388217600 00000100:00100000:0.0:1782481014.179753:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782481014.179762:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3310:x1869066388217600:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481014.179810:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef352850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3310:x1869066388217600:12345-0@lo:400:kworker.0 Request processed in 49us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481014.179817:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1782481014.179844:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388217728 00000100:00100000:0.0:1782481014.179847:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388217728 00000100:00100000:0.0:1782481014.179870:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388217856 00000100:00100000:0.0:1782481014.179873:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388217856 00000100:00100000:0.0:1782481014.179884:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782481014.179889:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388217728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481014.179929:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388217728:12345-0@lo:400:kworker.0 Request processed in 40us (411us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481014.179935:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1782481014.179947:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1782481014.179952:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1869066388217856:12345-0@lo:8:kworker.0 00010000:00080000:0.0:1782481014.179975:0:14842:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 544 last 0 00000100:00100000:3.0:1782481014.182131:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388218240 00000100:00100000:3.0:1782481014.182145:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388218240 00000100:00100000:3.0:1782481014.182198:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388217984 00000100:00100000:3.0:1782481014.182201:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388217984 00000100:00100000:3.0:1782481014.182214:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388218112 00000100:00100000:3.0:1782481014.182217:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388218112 00000100:00100000:3.0:1782481014.182235:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782481014.182245:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388218240:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.182324:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388218240:12345-0@lo:400:kworker.0 Request processed in 80us (2858us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481014.182332:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1782481014.182349:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782481014.182355:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388217984:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.182390:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3ba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388217984:12345-0@lo:400:kworker.0 Request processed in 36us (2777us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481014.182396:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1782481014.182406:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1782481014.182411:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388218112:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481014.182456:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388218112:12345-0@lo:400:kworker.0 Request processed in 45us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481014.182463:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00080000:3.0:1782481014.182728:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1782481014.182768:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b0700 x1869066388218112/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481014.182784:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388218112:0@lo:400:kworker.0 00010000:00080000:3.0:1782481014.182797:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b2300 x1869066388217984/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1782481014.182806:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388217984:0@lo:400:kworker.0 00000020:00000080:0.0:1782481014.184111:0:14842:0:(genops.c:1406:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x4776e02a9acf63b8 00002000:00100000:0.0:1782481014.184133:0:14842:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff91d7c7ca1800 ocd_connect_flags: 0xa044401443000026 ocd_version: 2113662 ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1782481014.184139:0:14842:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:0.0:1782481014.184142:0:14842:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1782481014.184440:0:14842:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1782481014.184474:0:14842:0:(import.c:65:import_set_state_nolock()) ffff91d7c7ca2000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481014.184573:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1869066388217856:12345-0@lo:8:kworker.0 Request processed in 4617us (5001us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481014.184582:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1782481014.184815:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b3b80 x1869066388217856/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1782481039 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1782481014.184840:0:3309:0:(import.c:1134:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1782481014.184858:0:3309:0:(import.c:961:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1782481014.184866:0:3309:0:(import.c:1215:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:2.0:1782481014.184870:0:3309:0:(import.c:65:import_set_state_nolock()) ffff91d7c77ca000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1782481014.184910:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1782481014.184918:0:3309:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1869066388217856:0@lo:8:kworker.0 00000004:00080000:3.0:1782481014.184955:0:14231:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x5:0x0] 00000100:00100000:3.0:1782481014.184983:0:14231:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14231:1869066388218496:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782481014.185078:0:14230:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1782481014.185575:0:14230:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 544746915372ns, next at 0ns, rc = 0 00000100:00100000:0.0:1782481014.188166:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388217728:0@lo:400:kworker.0 00000100:00100000:0.0:1782481014.188187:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388217600:0@lo:400:kworker.0 00010000:00080000:0.0:1782481014.188202:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7ff0b2a00 x1869066388218240/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1782481030 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481014.188213:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388218240:0@lo:400:kworker.0 00000100:00100000:0.0:1782481014.188246:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782481014.188257:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388218368:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782481014.188324:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481014.188497:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388218368 00000100:00100000:0.0:1782481014.188517:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388218368 00000100:00100000:0.0:1782481014.188574:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1782481014.188582:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388218368:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782481014.188622:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782481014.188687:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388218368:12345-0@lo:13:osp-pre-1-0.0 Request processed in 105us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481014.188694:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1782481014.188726:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff91d7efe73b80 x1869066388218368/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1782481030 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1782481014.188741:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388218368:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1782481014.188858:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1782481014.188889:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481014.188905:0:14231:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c2c53b40 going to sleep for 11 seconds 00000100:00100000:0.0:1782481014.190056:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388218496 00000100:00100000:0.0:1782481014.190067:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388218496 00000100:00100000:0.0:1782481014.190106:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1782481014.190115:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14231:x1869066388218496:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1782481014.192739:0:14842:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1782481014.192751:0:14842:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1782481014.192757:0:14842:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:6 to 0x280000400:33) 00002000:00010000:1.0:1782481014.207269:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.207285:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3fce0d8/0x4776e02a9acf63bf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.207304:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.207309:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.207316:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c3fce0d8/0x4776e02a9acf63bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.207334:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c3fce0d8/0x4776e02a9acf63bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.207344:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c3fce0d8/0x4776e02a9acf63bf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.207353:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c3fce0d8/0x4776e02a9acf63bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.207397:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481014.207559:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481014.207575:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c3fce0d8/0x4776e02a9acf63bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481014.207593:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782481014.207601:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3fce0d8/0x4776e02a9acf63bf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481014.207617:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c3fce0d8/0x4776e02a9acf63bf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1782481014.208040:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.208049:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad6be1b/0x4776e02a9acf63c6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.208060:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.208062:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.208066:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007ad6be1b/0x4776e02a9acf63c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.208075:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007ad6be1b/0x4776e02a9acf63c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.208083:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007ad6be1b/0x4776e02a9acf63c6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.208089:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007ad6be1b/0x4776e02a9acf63c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.208109:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.208125:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481014.208546:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c3fce0d8/0x4776e02a9acf63bf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481014.208560:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c3fce0d8/0x4776e02a9acf63bf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481014.208610:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481014.208612:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481014.208616:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.208622:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.208632:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e20352c/0x4776e02a9acf63cd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.208641:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.208651:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.208681:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005e20352c/0x4776e02a9acf63cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.208692:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005e20352c/0x4776e02a9acf63cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.208700:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005e20352c/0x4776e02a9acf63cd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.208708:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005e20352c/0x4776e02a9acf63cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.208724:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1782481014.208823:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481014.208831:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005e20352c/0x4776e02a9acf63cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481014.208843:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058c00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782481014.208848:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005e20352c/0x4776e02a9acf63cd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481014.208858:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005e20352c/0x4776e02a9acf63cd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481014.208875:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005e20352c/0x4776e02a9acf63cd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481014.208884:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005e20352c/0x4776e02a9acf63cd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481014.208909:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481014.208912:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481014.208916:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.214760:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.214777:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2f11e5/0x4776e02a9acf63d4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.214794:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.214798:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.214805:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008f2f11e5/0x4776e02a9acf63d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.214821:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008f2f11e5/0x4776e02a9acf63d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.214832:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008f2f11e5/0x4776e02a9acf63d4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.214847:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008f2f11e5/0x4776e02a9acf63d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.214870:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.214884:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.214889:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008f2f11e5/0x4776e02a9acf63d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.214896:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.214901:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2f11e5/0x4776e02a9acf63d4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.214909:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008f2f11e5/0x4776e02a9acf63d4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.214927:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008f2f11e5/0x4776e02a9acf63d4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.214934:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008f2f11e5/0x4776e02a9acf63d4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.214954:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.214956:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.214958:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.215428:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.215442:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c444042/0x4776e02a9acf63db lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.215450:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.215454:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.215458:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c444042/0x4776e02a9acf63db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.215466:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c444042/0x4776e02a9acf63db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.215474:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c444042/0x4776e02a9acf63db lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.215481:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c444042/0x4776e02a9acf63db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.215501:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782481014.215941:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.215947:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf637f8f/0x4776e02a9acf63e2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.215956:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.215959:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.215963:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf637f8f/0x4776e02a9acf63e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.215973:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf637f8f/0x4776e02a9acf63e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.215988:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf637f8f/0x4776e02a9acf63e2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.215995:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf637f8f/0x4776e02a9acf63e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216015:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:1.0:1782481014.216399:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.216405:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa0fe0a/0x4776e02a9acf63e9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216413:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.216416:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.216420:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efa0fe0a/0x4776e02a9acf63e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216428:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efa0fe0a/0x4776e02a9acf63e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216435:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000efa0fe0a/0x4776e02a9acf63e9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216443:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000efa0fe0a/0x4776e02a9acf63e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216462:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 00002000:00010000:1.0:1782481014.216919:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.216925:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000839d171c/0x4776e02a9acf63f0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216935:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.216938:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.216941:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000839d171c/0x4776e02a9acf63f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216950:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000839d171c/0x4776e02a9acf63f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216957:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000839d171c/0x4776e02a9acf63f0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216966:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000839d171c/0x4776e02a9acf63f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.216973:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to regular blp list, 4 blwis in pool 00002000:00010000:1.0:1782481014.217360:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.217365:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f82a8ac0/0x4776e02a9acf63f7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.217373:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.217381:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.217385:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f82a8ac0/0x4776e02a9acf63f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.217394:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f82a8ac0/0x4776e02a9acf63f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.217402:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f82a8ac0/0x4776e02a9acf63f7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.217409:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f82a8ac0/0x4776e02a9acf63f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.217417:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to regular blp list, 5 blwis in pool 00002000:00010000:1.0:1782481014.217862:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.217868:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc4593c/0x4776e02a9acf63fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.217876:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.217879:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.217883:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002bc4593c/0x4776e02a9acf63fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.217892:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002bc4593c/0x4776e02a9acf63fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.217901:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002bc4593c/0x4776e02a9acf63fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.217914:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002bc4593c/0x4776e02a9acf63fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.217921:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to regular blp list, 6 blwis in pool 00010000:00010000:0.0:1782481014.218074:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:0.0:1782481014.218083:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c444042/0x4776e02a9acf63db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218091:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481014.218096:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c444042/0x4776e02a9acf63db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218104:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c444042/0x4776e02a9acf63db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218130:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c444042/0x4776e02a9acf63db lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218137:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c444042/0x4776e02a9acf63db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218158:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:0.0:1782481014.218162:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf637f8f/0x4776e02a9acf63e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218169:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058a00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481014.218172:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf637f8f/0x4776e02a9acf63e2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218180:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf637f8f/0x4776e02a9acf63e2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218189:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf637f8f/0x4776e02a9acf63e2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218196:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf637f8f/0x4776e02a9acf63e2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218210:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:0.0:1782481014.218213:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000efa0fe0a/0x4776e02a9acf63e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218225:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802058200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481014.218228:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa0fe0a/0x4776e02a9acf63e9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218235:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000efa0fe0a/0x4776e02a9acf63e9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218245:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000efa0fe0a/0x4776e02a9acf63e9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218251:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efa0fe0a/0x4776e02a9acf63e9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218263:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1782481014.218266:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000839d171c/0x4776e02a9acf63f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218272:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167a800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481014.218274:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000839d171c/0x4776e02a9acf63f0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218280:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000839d171c/0x4776e02a9acf63f0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218288:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000839d171c/0x4776e02a9acf63f0 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218300:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000839d171c/0x4776e02a9acf63f0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218312:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782481014.218315:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f82a8ac0/0x4776e02a9acf63f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218320:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481014.218323:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f82a8ac0/0x4776e02a9acf63f7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218330:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f82a8ac0/0x4776e02a9acf63f7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218340:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f82a8ac0/0x4776e02a9acf63f7 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218346:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f82a8ac0/0x4776e02a9acf63f7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218356:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481014.218359:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002bc4593c/0x4776e02a9acf63fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218366:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167a400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481014.218375:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc4593c/0x4776e02a9acf63fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218383:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002bc4593c/0x4776e02a9acf63fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218393:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002bc4593c/0x4776e02a9acf63fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218401:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002bc4593c/0x4776e02a9acf63fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.218412:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481014.218414:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481014.218415:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.219453:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.219463:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000504d535b/0x4776e02a9acf6405 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219475:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.219479:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.219484:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000504d535b/0x4776e02a9acf6405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219495:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000504d535b/0x4776e02a9acf6405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219504:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000504d535b/0x4776e02a9acf6405 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219511:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000504d535b/0x4776e02a9acf6405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219529:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.219540:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.219544:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000504d535b/0x4776e02a9acf6405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219557:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.219561:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000504d535b/0x4776e02a9acf6405 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219570:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000504d535b/0x4776e02a9acf6405 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219582:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000504d535b/0x4776e02a9acf6405 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219588:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000504d535b/0x4776e02a9acf6405 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219601:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.219603:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.219605:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.219643:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.219651:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007ad6be1b/0x4776e02a9acf63c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219677:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d802059400 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.219680:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad6be1b/0x4776e02a9acf63c6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219687:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007ad6be1b/0x4776e02a9acf63c6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219705:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007ad6be1b/0x4776e02a9acf63c6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219713:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007ad6be1b/0x4776e02a9acf63c6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.219728:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.219729:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.219731:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.220149:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.220154:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7789415/0x4776e02a9acf640c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220163:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.220166:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.220170:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b7789415/0x4776e02a9acf640c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220179:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b7789415/0x4776e02a9acf640c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220186:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b7789415/0x4776e02a9acf640c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220192:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b7789415/0x4776e02a9acf640c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220217:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.220226:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.220230:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b7789415/0x4776e02a9acf640c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220235:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167ba00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.220238:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7789415/0x4776e02a9acf640c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220245:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b7789415/0x4776e02a9acf640c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220255:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b7789415/0x4776e02a9acf640c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220261:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b7789415/0x4776e02a9acf640c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220272:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.220274:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.220275:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.220280:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.220282:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.220778:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.220784:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e050edf/0x4776e02a9acf6413 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220802:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.220804:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.220808:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007e050edf/0x4776e02a9acf6413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220817:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007e050edf/0x4776e02a9acf6413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220826:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007e050edf/0x4776e02a9acf6413 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220833:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007e050edf/0x4776e02a9acf6413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220846:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.220854:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.220857:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007e050edf/0x4776e02a9acf6413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220864:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167a000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.220868:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007e050edf/0x4776e02a9acf6413 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220875:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007e050edf/0x4776e02a9acf6413 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220896:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007e050edf/0x4776e02a9acf6413 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220902:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007e050edf/0x4776e02a9acf6413 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.220917:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.220918:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.220920:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.221340:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.221347:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000714c566d/0x4776e02a9acf641a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221355:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.221357:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.221361:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000714c566d/0x4776e02a9acf641a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221370:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000714c566d/0x4776e02a9acf641a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221377:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000714c566d/0x4776e02a9acf641a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221383:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000714c566d/0x4776e02a9acf641a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221407:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.221417:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.221420:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000714c566d/0x4776e02a9acf641a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221427:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167ac00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.221430:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000714c566d/0x4776e02a9acf641a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221437:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000714c566d/0x4776e02a9acf641a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221449:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000714c566d/0x4776e02a9acf641a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221456:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000714c566d/0x4776e02a9acf641a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221469:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.221471:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.221472:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.221866:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.221872:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda0a4a4/0x4776e02a9acf6421 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221880:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.221888:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.221892:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cda0a4a4/0x4776e02a9acf6421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221902:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cda0a4a4/0x4776e02a9acf6421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221910:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000cda0a4a4/0x4776e02a9acf6421 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221916:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000cda0a4a4/0x4776e02a9acf6421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.221931:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782481014.225945:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.225958:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2d68526/0x4776e02a9acf6428 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.225976:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.225980:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.225986:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f2d68526/0x4776e02a9acf6428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.225999:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f2d68526/0x4776e02a9acf6428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226023:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f2d68526/0x4776e02a9acf6428 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226038:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f2d68526/0x4776e02a9acf6428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226057:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782481014.226076:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782481014.226083:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000cda0a4a4/0x4776e02a9acf6421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226091:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.226095:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda0a4a4/0x4776e02a9acf6421 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226104:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000cda0a4a4/0x4776e02a9acf6421 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226122:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000cda0a4a4/0x4776e02a9acf6421 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226130:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cda0a4a4/0x4776e02a9acf6421 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226149:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.226152:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f2d68526/0x4776e02a9acf6428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226169:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167be00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.226172:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2d68526/0x4776e02a9acf6428 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226181:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f2d68526/0x4776e02a9acf6428 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226192:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f2d68526/0x4776e02a9acf6428 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226200:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f2d68526/0x4776e02a9acf6428 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226213:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.226214:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.226216:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.226225:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.226642:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.226648:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c568ab90/0x4776e02a9acf642f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226677:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.226681:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.226686:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c568ab90/0x4776e02a9acf642f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226707:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c568ab90/0x4776e02a9acf642f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226716:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c568ab90/0x4776e02a9acf642f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226723:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c568ab90/0x4776e02a9acf642f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226739:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.226750:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.226754:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c568ab90/0x4776e02a9acf642f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226761:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167a200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.226764:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c568ab90/0x4776e02a9acf642f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226772:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c568ab90/0x4776e02a9acf642f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226783:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c568ab90/0x4776e02a9acf642f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226789:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c568ab90/0x4776e02a9acf642f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.226809:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.226811:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.226813:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.227216:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.227222:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674b3981/0x4776e02a9acf6436 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227230:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.227232:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.227237:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000674b3981/0x4776e02a9acf6436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227246:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000674b3981/0x4776e02a9acf6436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227253:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000674b3981/0x4776e02a9acf6436 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227261:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000674b3981/0x4776e02a9acf6436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227276:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.227284:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.227288:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000674b3981/0x4776e02a9acf6436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227306:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167bc00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.227309:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000674b3981/0x4776e02a9acf6436 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227316:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000674b3981/0x4776e02a9acf6436 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227327:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000674b3981/0x4776e02a9acf6436 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227333:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000674b3981/0x4776e02a9acf6436 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227346:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.227347:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.227348:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.227764:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.227770:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000febbb246/0x4776e02a9acf643d lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227778:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.227781:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.227784:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000febbb246/0x4776e02a9acf643d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227793:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000febbb246/0x4776e02a9acf643d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227806:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000febbb246/0x4776e02a9acf643d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227813:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000febbb246/0x4776e02a9acf643d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227827:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.227837:0:15804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.227841:0:15804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000febbb246/0x4776e02a9acf643d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227848:0:15804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167b600 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.227850:0:15804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000febbb246/0x4776e02a9acf643d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227857:0:15804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000febbb246/0x4776e02a9acf643d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227867:0:15804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000febbb246/0x4776e02a9acf643d lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227874:0:15804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000febbb246/0x4776e02a9acf643d lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.227887:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.227894:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.227895:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.228290:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.228296:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007da61c08/0x4776e02a9acf6444 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228304:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.228306:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.228310:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000007da61c08/0x4776e02a9acf6444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228319:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000007da61c08/0x4776e02a9acf6444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228326:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000007da61c08/0x4776e02a9acf6444 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228333:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000007da61c08/0x4776e02a9acf6444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228349:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.228357:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.228361:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000007da61c08/0x4776e02a9acf6444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228368:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c167aa00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.228371:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000007da61c08/0x4776e02a9acf6444 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228390:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000007da61c08/0x4776e02a9acf6444 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228401:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000007da61c08/0x4776e02a9acf6444 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228408:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000007da61c08/0x4776e02a9acf6444 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228422:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.228424:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.228425:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.228865:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.228871:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b936a4e/0x4776e02a9acf644b lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228880:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.228883:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.228887:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005b936a4e/0x4776e02a9acf644b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228896:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005b936a4e/0x4776e02a9acf644b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228904:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005b936a4e/0x4776e02a9acf644b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228921:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005b936a4e/0x4776e02a9acf644b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228936:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.228945:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.228949:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005b936a4e/0x4776e02a9acf644b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228956:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2092800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.228959:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005b936a4e/0x4776e02a9acf644b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228966:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005b936a4e/0x4776e02a9acf644b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228977:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005b936a4e/0x4776e02a9acf644b lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.228982:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005b936a4e/0x4776e02a9acf644b lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.235934:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.235941:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.235943:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.236607:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.236628:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949faa16/0x4776e02a9acf6452 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.236645:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.236650:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.236686:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000949faa16/0x4776e02a9acf6452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.236702:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000949faa16/0x4776e02a9acf6452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.236713:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000949faa16/0x4776e02a9acf6452 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.236720:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000949faa16/0x4776e02a9acf6452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.236745:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1782481014.237148:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.237154:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b9c3bd/0x4776e02a9acf6459 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237162:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.237165:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.237169:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b9c3bd/0x4776e02a9acf6459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237178:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f1b9c3bd/0x4776e02a9acf6459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237193:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f1b9c3bd/0x4776e02a9acf6459 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237200:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f1b9c3bd/0x4776e02a9acf6459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237220:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1782481014.237234:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1782481014.237239:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000949faa16/0x4776e02a9acf6452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237247:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2092e00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.237252:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000949faa16/0x4776e02a9acf6452 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237261:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000949faa16/0x4776e02a9acf6452 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237278:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000949faa16/0x4776e02a9acf6452 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237286:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000949faa16/0x4776e02a9acf6452 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237307:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.237316:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f1b9c3bd/0x4776e02a9acf6459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237322:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2092000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.237325:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b9c3bd/0x4776e02a9acf6459 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237332:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f1b9c3bd/0x4776e02a9acf6459 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237341:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f1b9c3bd/0x4776e02a9acf6459 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237348:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f1b9c3bd/0x4776e02a9acf6459 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237360:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.237362:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.237363:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.237787:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.237793:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000275d6173/0x4776e02a9acf6460 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237802:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.237805:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.237810:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000275d6173/0x4776e02a9acf6460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237830:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000275d6173/0x4776e02a9acf6460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237839:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000275d6173/0x4776e02a9acf6460 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237845:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000275d6173/0x4776e02a9acf6460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237861:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.237871:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.237875:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000275d6173/0x4776e02a9acf6460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237882:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2093600 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.237885:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000275d6173/0x4776e02a9acf6460 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237893:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000275d6173/0x4776e02a9acf6460 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237904:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000275d6173/0x4776e02a9acf6460 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237911:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000275d6173/0x4776e02a9acf6460 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.237932:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.237933:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.237935:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.238339:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.238345:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444dcb53/0x4776e02a9acf6467 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238354:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.238356:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.238361:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000444dcb53/0x4776e02a9acf6467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238369:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000444dcb53/0x4776e02a9acf6467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238377:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000444dcb53/0x4776e02a9acf6467 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238384:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000444dcb53/0x4776e02a9acf6467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238399:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.238407:0:14196:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.238410:0:14196:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000444dcb53/0x4776e02a9acf6467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238428:0:14196:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2092c00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.238431:0:14196:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000444dcb53/0x4776e02a9acf6467 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238439:0:14196:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000444dcb53/0x4776e02a9acf6467 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238450:0:14196:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000444dcb53/0x4776e02a9acf6467 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238458:0:14196:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000444dcb53/0x4776e02a9acf6467 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238472:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.238474:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.238475:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1782481014.238901:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1782481014.238906:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d1b8aba/0x4776e02a9acf646e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238915:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=544s v=(0 0) 00010000:00010000:1.0:1782481014.238918:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481014.238921:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d1b8aba/0x4776e02a9acf646e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238929:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d1b8aba/0x4776e02a9acf646e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238943:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d1b8aba/0x4776e02a9acf646e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238949:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d1b8aba/0x4776e02a9acf646e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238963:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1782481014.238971:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1782481014.238975:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d1b8aba/0x4776e02a9acf646e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238981:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2092a00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481014.238984:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d1b8aba/0x4776e02a9acf646e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.238991:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d1b8aba/0x4776e02a9acf646e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481014.239279:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481014.240804:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782481014.240815:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf6475 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.240830:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1782481014.240834:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481014.240840:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf6475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.240851:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf6475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.240860:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf6475 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.240871:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf6475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.240887:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1782481014.241285:0:14842:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1782481014.241292:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046cb6ae3/0x4776e02a9acf647c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241300:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=544s v=(0 0) 00010000:00010000:0.0:1782481014.241303:0:14842:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481014.241308:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000046cb6ae3/0x4776e02a9acf647c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241316:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000046cb6ae3/0x4776e02a9acf647c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241324:0:14842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000046cb6ae3/0x4776e02a9acf647c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241331:0:14842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000046cb6ae3/0x4776e02a9acf647c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241348:0:14842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1782481014.241361:0:15804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1782481014.241366:0:15804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf6475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241380:0:15804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481014.241385:0:15804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf6475 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241394:0:15804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf6475 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241410:0:15804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf6475 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241416:0:15804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bf5f1cf3/0x4776e02a9acf6475 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241436:0:15804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1782481014.241440:0:15804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000046cb6ae3/0x4776e02a9acf647c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241446:0:15804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481014.241449:0:15804:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000046cb6ae3/0x4776e02a9acf647c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241457:0:15804:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000046cb6ae3/0x4776e02a9acf647c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241466:0:15804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000046cb6ae3/0x4776e02a9acf647c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241478:0:15804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000046cb6ae3/0x4776e02a9acf647c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481014.241490:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481014.241491:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481014.241493:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1782481014.241695:0:14842:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:5 00000100:00100000:0.0:1782481014.241797:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe72a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14231:x1869066388218496:12345-0@lo:5:osp-pre-1-0.0 Request processed in 51679us (52903us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481014.241807:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00010000:0.0:1782481014.241849:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481014.242119:0:14231:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14231:1869066388218496:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1782481014.242133:0:14231:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x5:0x0] 00000100:00100000:3.0:1782481014.242176:0:14231:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe71500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14231:1869066388218624:0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1782481014.242209:0:14231:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481014.242231:0:14231:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c2c53b40 going to sleep for 11 seconds 00000100:00100000:3.0:1782481014.242246:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388218624 00000100:00100000:3.0:1782481014.242251:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388218624 00000100:00100000:3.0:1782481014.242289:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1782481014.242298:0:14845:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14231:x1869066388218624:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1782481014.242340:0:14845:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00010000:00010000:1.0:1782481014.249686:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d1b8aba/0x4776e02a9acf646e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.249708:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d1b8aba/0x4776e02a9acf646e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481014.249745:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.249757:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481014.249759:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481014.253548:0:14845:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14231:x1869066388218624:12345-0@lo:5:osp-pre-1-0.0 Request processed in 11243us (11330us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1782481014.253561:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782481014.255317:0:14231:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe71500 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14231:1869066388218624:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1782481014.255334:0:14231:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000004:00080000:0.0:1782481014.296142:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00010000:00010000:0.0:1782481014.434771:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481015.466258:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782481015.835599:0:15872:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg158-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1782481016.495823:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481017.505705:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1782481018.213100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481018.213209:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366199680 00000100:00100000:1.0:1782481018.213220:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366199680 00000100:00100000:1.0:1782481018.213269:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:1.0:1782481018.213278:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2349:x1869066366199680:12345-192.168.201.58@tcp:250:mount.lustre.0 00010000:00080000:1.0:1782481018.213306:0:14202:0:(ldlm_lib.c:1432:target_handle_connect()) MGS: connection from 75c6703e-3e35-47d3-ae4e-07cd32be5e35@192.168.201.58@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:0.0:1782481018.219576:0:14202:0:(genops.c:1406:class_connect()) connect: client 75c6703e-3e35-47d3-ae4e-07cd32be5e35, cookie 0x4776e02a9acf6483 00000100:00080000:0.0:1782481018.220409:0:14202:0:(import.c:65:import_set_state_nolock()) ffff91d7c92f5800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1782481018.220549:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef350050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+5:2349:x1869066366199680:12345-192.168.201.58@tcp:250:mount.lustre.0 Request processed in 7267us (7454us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481018.220562:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 76 00000100:00100000:0.0:1782481018.229090:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481018.229180:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366199808 00000100:00100000:2.0:1782481018.229202:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366199808 00000100:00100000:2.0:1782481018.229273:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:2.0:1782481018.229284:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+5:13694:x1869066366199808:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782481018.229303:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481018.229324:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2d200/0x4776e02a9acf648a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0027 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.229365:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2d200/0x4776e02a9acf648a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0027 expref: 6 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.229377:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2d200/0x4776e02a9acf648a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0027 expref: 6 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.229386:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d200, rc 0) 00000100:00100000:2.0:1782481018.229447:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef351450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+6:13694:x1869066366199808:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 165us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481018.229454:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 77 00000100:00100000:3.0:1782481018.235169:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.235253:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366199936 00000100:00100000:0.0:1782481018.235411:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366199936 00000100:00100000:0.0:1782481018.235522:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:0.0:1782481018.235533:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+6:13694:x1869066366199936:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782481018.235867:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4daac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+6:13694:x1869066366199936:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 335us (712us total) trans 0 rc -2/-2 00000100:00100000:0.0:1782481018.235885:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 78 00000100:00100000:3.0:1782481018.244165:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.244953:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366200064 00000100:00100000:0.0:1782481018.244963:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366200064 00000100:00100000:0.0:1782481018.245026:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:0.0:1782481018.245036:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+6:13694:x1869066366200064:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782481018.245055:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481018.245072:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf6491 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d9a002e expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481018.245100:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf6491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a002e expref: 7 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481018.245112:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297a200/0x4776e02a9acf6491 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a002e expref: 7 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481018.245121:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a200, rc 0) 00000100:00100000:0.0:1782481018.245191:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4daa850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+7:13694:x1869066366200064:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 155us (1035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481018.245198:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 79 00000100:00100000:1.0:1782481018.248973:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.249075:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366200192 00000100:00100000:0.0:1782481018.249085:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366200192 00000100:00100000:0.0:1782481018.249142:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:0.0:1782481018.249153:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+7:13694:x1869066366200192:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782481018.249582:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4da8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+8:13694:x1869066366200192:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 428us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481018.249591:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 80 00000100:00100000:2.0:1782481018.260073:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.263153:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366200320 00000100:00100000:0.0:1782481018.263168:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366200320 00000100:00100000:0.0:1782481018.263369:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:0.0:1782481018.263380:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+8:13694:x1869066366200320:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782481018.264552:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4da9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+8:13694:x1869066366200320:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 1166us (4480us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481018.264573:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 81 00000100:00100000:3.0:1782481018.271106:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.271696:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388218752:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1782481018.271747:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481018.271913:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366200448 00000100:00100000:1.0:1782481018.271929:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366200448 00000100:00100000:1.0:1782481018.271983:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:1.0:1782481018.271991:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+8:13713:x1869066366200448:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782481018.272230:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed422850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+8:13713:x1869066366200448:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 238us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481018.272238:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 82 00000100:00100000:3.0:1782481018.272501:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388218752 00000100:00100000:3.0:1782481018.272506:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388218752 00000100:00100000:3.0:1782481018.272558:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782481018.273749:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388218752:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1782481018.273800:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1782481018.273868:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388218752:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1303us (2120us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481018.273875:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:1.0:1782481018.273997:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1782481018.274521:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e76680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388218752:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782481018.294457:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.295059:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366200576 00000100:00100000:0.0:1782481018.295071:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366200576 00000100:00100000:0.0:1782481018.295169:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:0.0:1782481018.295180:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+8:13713:x1869066366200576:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782481018.295475:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed421850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+8:13713:x1869066366200576:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 296us (1027us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481018.295483:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 83 00000100:00100000:0.0:1782481018.313508:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481018.315334:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366200704 00000100:00100000:2.0:1782481018.315440:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366200704 00000100:00100000:2.0:1782481018.315555:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:2.0:1782481018.315573:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed420050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+8:13694:x1869066366200704:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782481018.315593:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481018.315612:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2de00/0x4776e02a9acf6498 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0058 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.315647:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2de00/0x4776e02a9acf6498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0058 expref: 9 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.315692:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2de00/0x4776e02a9acf6498 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0058 expref: 9 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.315702:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2de00, rc 0) 00000100:00100000:2.0:1782481018.315767:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed420050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+9:13694:x1869066366200704:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 204us (2268us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481018.315886:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 84 00000100:00100000:3.0:1782481018.331731:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.331844:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366200832 00000100:00100000:0.0:1782481018.331855:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366200832 00000100:00100000:0.0:1782481018.331908:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:0.0:1782481018.331924:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+9:13694:x1869066366200832:12345-192.168.201.58@tcp:256:mount.lustre.0 20000000:01000000:0.0:1782481018.331964:0:14200:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1782481018.331993:0:14200:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1782481018.331998:0:14200:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1782481018.332005:0:14200:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1782481018.332008:0:14200:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1782481018.337621:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed421450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+9:13694:x1869066366200832:12345-192.168.201.58@tcp:256:mount.lustre.0 Request processed in 5692us (5889us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481018.337645:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 85 00000100:00100000:2.0:1782481018.347869:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.348054:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366200960 00000100:00100000:0.0:1782481018.348063:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366200960 00000100:00100000:0.0:1782481018.348162:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:0.0:1782481018.348171:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+9:13694:x1869066366200960:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:0.0:1782481018.348190:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481018.348207:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf649f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d9a005f expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481018.348237:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf649f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a005f expref: 10 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481018.348249:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf649f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a005f expref: 10 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481018.348272:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782481018.348333:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed421050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:13694:x1869066366200960:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 163us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481018.348340:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 86 00000100:00100000:2.0:1782481018.359714:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.359950:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366201088 00000100:00100000:0.0:1782481018.359960:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366201088 00000100:00100000:0.0:1782481018.360027:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:0.0:1782481018.360036:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:13694:x1869066366201088:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:0.0:1782481018.361310:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed420c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:13694:x1869066366201088:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 1266us (1597us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481018.361322:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 87 00000100:00100000:2.0:1782481018.380018:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.380282:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366201216 00000100:00100000:0.0:1782481018.380300:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366201216 00000100:00100000:0.0:1782481018.380376:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:0.0:1782481018.380387:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:13694:x1869066366201216:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:0.0:1782481018.381162:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed423450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:13694:x1869066366201216:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 773us (1151us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481018.381194:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 88 00000100:00100000:2.0:1782481018.386886:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.387454:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366201344 00000100:00100000:0.0:1782481018.387464:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366201344 00000100:00100000:0.0:1782481018.387537:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 89 00000100:00100000:0.0:1782481018.387546:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:13717:x1869066366201344:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:0.0:1782481018.388297:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed422050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:13717:x1869066366201344:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 747us (1416us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481018.388307:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 89 00000100:00100000:0.0:1782481018.398172:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481018.398422:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366201472 00000100:00100000:1.0:1782481018.398434:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366201472 00000100:00100000:1.0:1782481018.398529:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:1.0:1782481018.398540:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:13717:x1869066366201472:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782481018.399237:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed420450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:13717:x1869066366201472:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 695us (1072us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481018.399246:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 90 00000100:00100000:1.0:1782481018.416363:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481018.417093:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366201600 00000100:00100000:3.0:1782481018.417109:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366201600 00000100:00100000:3.0:1782481018.417226:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:3.0:1782481018.417236:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2349:x1869066366201600:12345-192.168.201.58@tcp:38:mount.lustre.0 00010000:00080000:3.0:1782481018.417280:0:14208:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from 3057645e-c20b-49f1-9cb3-c94df18fd1de@192.168.201.58@tcp t0 exp 0000000000000000 cur 548 last 0 00000020:00000080:3.0:1782481018.417327:0:14208:0:(genops.c:1406:class_connect()) connect: client 3057645e-c20b-49f1-9cb3-c94df18fd1de, cookie 0x4776e02a9acf64a6 00000004:00100000:3.0:1782481018.417374:0:14208:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:3.0:1782481018.417381:0:14208:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:3.0:1782481018.447177:0:14208:0:(import.c:65:import_set_state_nolock()) ffff91d6c29a4000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1782481018.447273:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e76680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:2349:x1869066366201600:12345-192.168.201.58@tcp:38:mount.lustre.0 Request processed in 30036us (30918us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481018.447297:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:0.0:1782481018.450923:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.450976:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481018.451050:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366201856 00000100:00100000:3.0:1782481018.451060:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366201856 00000100:00100000:3.0:1782481018.451115:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366201728 00000100:00100000:3.0:1782481018.451116:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366201728 00000100:00100000:3.0:1782481018.451127:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1782481018.451134:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:13694:x1869066366201856:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782481018.451178:0:14206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782481018.451293:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:13694:x1869066366201856:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 159us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481018.451298:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1782481018.451312:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:3.0:1782481018.451318:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:0:x1869066366201728:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782481018.451329:0:14206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00080000:0.0:1782481018.451504:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782481018.451561:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:0:x1869066366201728:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 241us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481018.451568:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1782481018.462010:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481018.462089:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366201984 00000100:00100000:3.0:1782481018.462097:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366201984 00000100:00100000:3.0:1782481018.462147:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:3.0:1782481018.462155:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:13694:x1869066366201984:12345-192.168.201.58@tcp:40:mount.lustre.0 00000100:00100000:3.0:1782481018.462229:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:13694:x1869066366201984:12345-192.168.201.58@tcp:40:mount.lustre.0 Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481018.462234:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1782481018.465176:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481018.465203:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481018.465268:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366202112 00000100:00100000:3.0:1782481018.465290:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366202112 00000100:00100000:3.0:1782481018.465321:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366202240 00000100:00100000:3.0:1782481018.465323:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366202240 00000100:00100000:3.0:1782481018.465333:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:3.0:1782481018.465338:0:14845:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1869066366202112:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:3.0:1782481018.465369:0:14845:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from 3057645e-c20b-49f1-9cb3-c94df18fd1de@192.168.201.58@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:3.0:1782481018.465394:0:14845:0:(genops.c:1406:class_connect()) connect: client 3057645e-c20b-49f1-9cb3-c94df18fd1de, cookie 0x4776e02a9acf64ad 00002000:00100000:3.0:1782481018.465404:0:14845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 3057645e-c20b-49f1-9cb3-c94df18fd1de/ffff91d6c29a1000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1782481018.465412:0:14845:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1782481018.465756:0:14845:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1782481018.466201:0:14845:0:(import.c:65:import_set_state_nolock()) ffff91d7df544800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782481018.466269:0:14845:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e75c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:2349:x1869066366202112:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 928us (1099us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481018.466276:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1782481018.466294:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:1.0:1782481018.466298:0:14845:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2349:x1869066366202240:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:1.0:1782481018.466312:0:14845:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from 3057645e-c20b-49f1-9cb3-c94df18fd1de@192.168.201.58@tcp t0 exp 0000000000000000 cur 549 last 0 00000020:00000080:1.0:1782481018.466327:0:14845:0:(genops.c:1406:class_connect()) connect: client 3057645e-c20b-49f1-9cb3-c94df18fd1de, cookie 0x4776e02a9acf64b4 00002000:00100000:1.0:1782481018.466333:0:14845:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 3057645e-c20b-49f1-9cb3-c94df18fd1de/ffff91d6c3a29800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1782481018.466356:0:14845:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1782481018.466470:0:14845:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1782481018.466485:0:14845:0:(import.c:65:import_set_state_nolock()) ffff91d6c3a2a800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1782481018.466504:0:14845:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e77480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:2349:x1869066366202240:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 204us (1300us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481018.466508:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:0.0:1782481018.472761:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481018.472808:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481018.473037:0:14209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366202368 00000100:00100000:2.0:1782481018.473047:0:14209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366202368 00000100:00100000:2.0:1782481018.473090:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:2.0:1782481018.473097:0:14209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:13694:x1869066366202368:12345-192.168.201.58@tcp:33:mount.lustre.0 00000100:00100000:1.0:1782481018.473288:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366202496 00000100:00100000:1.0:1782481018.473292:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366202496 00000100:00100000:1.0:1782481018.473327:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 91 00000100:00100000:1.0:1782481018.473333:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:2352:x1869066366202496:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782481018.473404:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed423c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:2352:x1869066366202496:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 72us (594us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481018.473410:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 91 00000004:00080000:1.0:1782481018.474726:0:14209:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 1572us 00000004:00200000:1.0:1782481018.490643:0:14209:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1782481018.491205:0:14209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:13694:x1869066366202368:12345-192.168.201.58@tcp:33:mount.lustre.0 Request processed in 18100us (18447us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481018.491220:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00010000:00010000:1.0:1782481018.526899:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481018.634586:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481018.636326:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366202624 00000100:00100000:2.0:1782481018.636342:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366202624 00000100:00100000:2.0:1782481018.636418:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:2.0:1782481018.636429:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:13738:x1869066366202624:12345-192.168.201.58@tcp:101:mkdir.0 00010000:00010000:2.0:1782481018.636451:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481018.636485:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf64bb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0089 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.636833:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf64c2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.636849:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf64c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.636866:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf64c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481018.637221:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782481018.637226:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1782481018.637392:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf64c2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.637423:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf64bb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0089 expref: 8 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.637439:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf64c2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0089 expref: 7 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481018.637449:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610ba00) 00010000:00010000:2.0:1782481018.637452:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782481018.637456:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2c200, rc 0) 00000100:00100000:2.0:1782481018.637831:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:13738:x1869066366202624:12345-192.168.201.58@tcp:101:mkdir.0 Request processed in 1401us (3258us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481018.637840:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:1.0:1782481019.298889:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388218880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782481019.298983:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481019.299073:0:14847:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388218880 00000100:00100000:1.0:1782481019.299080:0:14847:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388218880 00000100:00080000:1.0:1782481019.300155:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782481019.300174:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782481019.300185:0:14847:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1869066388218880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1782481019.300211:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782481019.300279:0:14847:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e75f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1869066388218880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481019.300287:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1782481019.300339:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e75500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388218880:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1782481019.301051:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388219008:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301093:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481019.301123:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388219520:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301153:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481019.301173:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1782481019.301179:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388219136:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301202:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481019.301232:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388219520 00000100:00100000:3.0:1782481019.301237:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388219520 00000100:00100000:3.0:1782481019.301279:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1782481019.301286:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388219520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301326:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388219520:12345-0@lo:400:kworker.0 Request processed in 40us (171us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481019.301332:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00080000:3.0:1782481019.301349:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782481019.301367:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388219520:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301393:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388219264:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301417:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481019.301434:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1782481019.301439:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ff0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388219392:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301457:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481019.301477:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388219264 00000100:00100000:3.0:1782481019.301481:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388219264 00000100:00100000:3.0:1782481019.301498:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388219392 00000100:00100000:3.0:1782481019.301501:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388219392 00000100:00100000:3.0:1782481019.301523:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782481019.301529:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388219264:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301563:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388219264:12345-0@lo:400:kworker.0 Request processed in 34us (144us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481019.301569:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1782481019.301582:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1782481019.301587:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388219392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301614:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1869066388219392:12345-0@lo:400:kworker.0 Request processed in 27us (155us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481019.301619:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:3.0:1782481019.301632:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782481019.301652:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1869066388219392:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301687:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ff0b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388219264:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301711:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388219136 00000100:00100000:3.0:1782481019.301714:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388219136 00000100:00100000:3.0:1782481019.301740:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782481019.301747:0:14845:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388219136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.301787:0:14845:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388219136:12345-0@lo:400:kworker.0 Request processed in 41us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481019.301794:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1782481019.303934:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388219136:0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.303990:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388219008 00000100:00100000:3.0:1782481019.303998:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388219008 00000100:00100000:3.0:1782481019.304049:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782481019.304057:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3310:x1869066388219008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1782481019.304144:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed420850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3310:x1869066388219008:12345-0@lo:400:kworker.0 Request processed in 87us (3051us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481019.304151:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1782481019.304197:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe73b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388219008:0@lo:400:kworker.0 00000001:00100000:1.0:1782481019.402136:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 3057645e-c20b-49f1-9cb3-c94df18fd1de 00000001:00100000:1.0:1782481019.480953:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00100000:1.0:1782481019.480967:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 3057645e-c20b-49f1-9cb3-c94df18fd1de 00000001:00080000:1.0:1782481019.481007:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:1.0:1782481019.550891:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1782481020.063407:0:14240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782481020.579461:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481020.781051:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481020.781234:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366202752 00000100:00100000:1.0:1782481020.781243:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366202752 00000100:00100000:1.0:1782481020.781318:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1782481020.781333:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:13790:x1869066366202752:12345-192.168.201.58@tcp:41:lfs.0 00000004:00000024:1.0:1782481020.781380:0:14206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782481020.781496:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:13790:x1869066366202752:12345-192.168.201.58@tcp:41:lfs.0 Request processed in 167us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481020.781503:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00080000:3.0:1782481020.781861:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782481020.799895:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481020.801496:0:14847:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366202880 00000100:00100000:2.0:1782481020.801508:0:14847:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366202880 00000100:00100000:2.0:1782481020.801629:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:2.0:1782481020.801639:0:14847:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:13790:x1869066366202880:12345-192.168.201.58@tcp:13:lfs.0 00002000:00000024:2.0:1782481020.801714:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782481020.801797:0:14847:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e75500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:13790:x1869066366202880:12345-192.168.201.58@tcp:13:lfs.0 Request processed in 159us (1921us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481020.801805:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00080000:3.0:1782481020.802324:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782481020.809070:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481020.813644:0:14847:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366203008 00000100:00100000:1.0:1782481020.813692:0:14847:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366203008 00000100:00080000:3.0:1782481020.817395:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782481020.817586:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1782481020.817603:0:14847:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:13790:x1869066366203008:12345-192.168.201.58@tcp:13:lfs.0 00002000:00000024:0.0:1782481020.817644:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782481020.817770:0:14847:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fe680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:13790:x1869066366203008:12345-192.168.201.58@tcp:13:lfs.0 Request processed in 173us (8709us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481020.817793:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1782481021.068055:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481021.068171:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366203136 00000100:00100000:2.0:1782481021.068183:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366203136 00000100:00100000:2.0:1782481021.068246:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:2.0:1782481021.068256:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+10:13820:x1869066366203136:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782481021.068272:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481021.068289:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2cc00/0x4776e02a9acf64c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0090 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481021.068317:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2cc00/0x4776e02a9acf64c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0090 expref: 11 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481021.068328:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2cc00/0x4776e02a9acf64c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0090 expref: 11 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481021.068338:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2cc00, rc 0) 00000100:00100000:2.0:1782481021.068406:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed422450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13820:x1869066366203136:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 151us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481021.068413:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 93 00000100:00100000:1.0:1782481021.072472:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481021.072578:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366203264 00000100:00100000:3.0:1782481021.072589:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366203264 00000100:00100000:3.0:1782481021.072650:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:3.0:1782481021.072697:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13820:x1869066366203264:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782481021.073153:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed423850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13820:x1869066366203264:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 492us (694us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481021.073161:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 94 00000100:00100000:0.0:1782481021.079350:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481021.079445:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366203392 00000100:00100000:3.0:1782481021.079457:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366203392 00000100:00100000:3.0:1782481021.079522:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:3.0:1782481021.079549:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13820:x1869066366203392:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:3.0:1782481021.080151:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed421c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13820:x1869066366203392:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 602us (808us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481021.080161:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 95 00000100:00100000:1.0:1782481021.088552:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481021.088903:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366203520 00000100:00100000:2.0:1782481021.088925:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366203520 00000100:00100000:2.0:1782481021.088995:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:2.0:1782481021.089004:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13827:x1869066366203520:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782481021.089341:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed422c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13827:x1869066366203520:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 338us (799us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481021.089350:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 96 00000100:00100000:2.0:1782481021.123535:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481021.123704:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366203648 00000100:00100000:3.0:1782481021.123715:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366203648 00000100:00100000:3.0:1782481021.123787:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:3.0:1782481021.123798:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ed423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13827:x1869066366203648:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:3.0:1782481021.124325:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ed423050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13827:x1869066366203648:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 525us (796us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481021.124333:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 97 00000100:00100000:0.0:1782481021.142060:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481021.142187:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366203776 00000100:00100000:1.0:1782481021.142198:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366203776 00000100:00100000:1.0:1782481021.142255:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:1.0:1782481021.142266:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13820:x1869066366203776:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:1.0:1782481021.142283:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481021.142303:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c2092600/0x4776e02a9acf64d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d9a00ba expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.142333:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c2092600/0x4776e02a9acf64d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00ba expref: 12 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.142345:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c2092600/0x4776e02a9acf64d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00ba expref: 12 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481021.142369:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c2092600, rc 0) 00000100:00100000:1.0:1782481021.142437:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+12:13820:x1869066366203776:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 172us (385us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481021.142444:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 98 00000100:00100000:1.0:1782481021.171215:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481021.171351:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366203904 00000100:00100000:3.0:1782481021.171363:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366203904 00000100:00100000:3.0:1782481021.171420:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:3.0:1782481021.171430:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+12:13820:x1869066366203904:12345-192.168.201.58@tcp:256:mount.lustre.0 20000000:01000000:3.0:1782481021.171458:0:14202:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1782481021.171482:0:14202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1782481021.171486:0:14202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1782481021.171490:0:14202:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1782481021.171492:0:14202:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1782481021.179992:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+12:13820:x1869066366203904:12345-192.168.201.58@tcp:256:mount.lustre.0 Request processed in 8553us (8776us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481021.180007:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 99 00000100:00100000:0.0:1782481021.201748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481021.201957:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366204032 00000100:00100000:2.0:1782481021.201968:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366204032 00000100:00100000:2.0:1782481021.202025:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:2.0:1782481021.202035:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+12:13820:x1869066366204032:12345-192.168.201.58@tcp:101:mount.lustre.0 00010000:00010000:2.0:1782481021.202053:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481021.202072:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2d800/0x4776e02a9acf64d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d9a00c1 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481021.202101:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2d800/0x4776e02a9acf64d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00c1 expref: 13 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481021.202113:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2d800/0x4776e02a9acf64d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00c1 expref: 13 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481021.202122:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d800, rc 0) 00000100:00100000:2.0:1782481021.202292:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13820:x1869066366204032:12345-192.168.201.58@tcp:101:mount.lustre.0 Request processed in 258us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481021.202300:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 100 00000100:00100000:1.0:1782481021.204717:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481021.204902:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366204160 00000100:00100000:3.0:1782481021.205010:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366204160 00000100:00100000:3.0:1782481021.205577:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:3.0:1782481021.205600:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13820:x1869066366204160:12345-192.168.201.58@tcp:501:mount.lustre.0 00000100:00100000:3.0:1782481021.209598:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13820:x1869066366204160:12345-192.168.201.58@tcp:501:mount.lustre.0 Request processed in 3988us (4878us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481021.209613:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 101 00000100:00100000:3.0:1782481021.212518:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481021.212623:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366204288 00000100:00100000:2.0:1782481021.212633:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366204288 00000100:00100000:2.0:1782481021.212728:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:2.0:1782481021.212752:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13820:x1869066366204288:12345-192.168.201.58@tcp:503:mount.lustre.0 00000100:00100000:2.0:1782481021.213146:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13820:x1869066366204288:12345-192.168.201.58@tcp:503:mount.lustre.0 Request processed in 396us (637us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481021.213154:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 102 00000100:00100000:0.0:1782481021.216180:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481021.216263:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366204416 00000100:00100000:1.0:1782481021.216272:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366204416 00000100:00100000:1.0:1782481021.216321:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:1.0:1782481021.216329:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13832:x1869066366204416:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:1.0:1782481021.216591:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13832:x1869066366204416:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 261us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481021.216599:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 103 00000100:00100000:1.0:1782481021.229284:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481021.229377:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366204544 00000100:00100000:3.0:1782481021.229388:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366204544 00000100:00100000:3.0:1782481021.229446:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 104 00000100:00100000:3.0:1782481021.229455:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13832:x1869066366204544:12345-192.168.201.58@tcp:502:llog_process_th.0 00000100:00100000:2.0:1782481021.230237:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13832:x1869066366204544:12345-192.168.201.58@tcp:502:llog_process_th.0 Request processed in 780us (959us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481021.230247:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 104 00000100:00100000:3.0:1782481021.251029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481021.251497:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366204672 00000100:00100000:2.0:1782481021.251508:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366204672 00000100:00100000:2.0:1782481021.251564:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:2.0:1782481021.251573:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2349:x1869066366204672:12345-192.168.201.58@tcp:38:mount.lustre.0 00010000:00080000:2.0:1782481021.251607:0:14207:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-MDT0000: connection from b1c38af0-aec8-4f5a-b9a2-2cc36817ec45@192.168.201.58@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:2.0:1782481021.251645:0:14207:0:(genops.c:1406:class_connect()) connect: client b1c38af0-aec8-4f5a-b9a2-2cc36817ec45, cookie 0x4776e02a9acf64de 00000004:00100000:2.0:1782481021.251716:0:14207:0:(mdt_handler.c:7282:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1782481021.251848:0:14207:0:(import.c:65:import_set_state_nolock()) ffff91d6c3355800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782481021.251937:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:2349:x1869066366204672:12345-192.168.201.58@tcp:38:mount.lustre.0 Request processed in 364us (918us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481021.251945:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:0.0:1782481021.256593:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481021.256702:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366204800 00000100:00100000:3.0:1782481021.256714:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366204800 00000100:00100000:3.0:1782481021.256802:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:3.0:1782481021.256813:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:0:x1869066366204800:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:3.0:1782481021.256852:0:14208:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1782481021.256946:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:0:x1869066366204800:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 135us (363us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481021.256954:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00080000:0.0:1782481021.257233:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1782481021.258276:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481021.258361:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366204928 00000100:00100000:1.0:1782481021.258369:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366204928 00000100:00100000:1.0:1782481021.258416:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1782481021.258425:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:13820:x1869066366204928:12345-192.168.201.58@tcp:41:mount.lustre.0 00000004:00000024:1.0:1782481021.258460:0:14206:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1782481021.258521:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:13820:x1869066366204928:12345-192.168.201.58@tcp:41:mount.lustre.0 Request processed in 96us (252us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481021.258528:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1782481021.269029:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481021.269127:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366205056 00000100:00100000:2.0:1782481021.269139:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366205056 00000100:00100000:2.0:1782481021.269210:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1782481021.269221:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:13820:x1869066366205056:12345-192.168.201.58@tcp:40:mount.lustre.0 00000100:00100000:2.0:1782481021.269319:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e74000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:13820:x1869066366205056:12345-192.168.201.58@tcp:40:mount.lustre.0 Request processed in 99us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481021.269327:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:0.0:1782481021.273631:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481021.273873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481021.274095:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366205184 00000100:00100000:2.0:1782481021.274106:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366205184 00000100:00100000:2.0:1782481021.274150:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366205312 00000100:00100000:2.0:1782481021.274153:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366205312 00000100:00100000:2.0:1782481021.274171:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782481021.274179:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1869066366205184:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782481021.274214:0:14842:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0000: connection from b1c38af0-aec8-4f5a-b9a2-2cc36817ec45@192.168.201.58@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:2.0:1782481021.274253:0:14842:0:(genops.c:1406:class_connect()) connect: client b1c38af0-aec8-4f5a-b9a2-2cc36817ec45, cookie 0x4776e02a9acf64e5 00002000:00100000:2.0:1782481021.274267:0:14842:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli b1c38af0-aec8-4f5a-b9a2-2cc36817ec45/ffff91d6c3357000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782481021.274279:0:14842:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1782481021.274786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481021.275455:0:14210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366205440 00000100:00100000:3.0:1782481021.275463:0:14210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366205440 00000100:00100000:3.0:1782481021.275515:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:3.0:1782481021.275524:0:14210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:13820:x1869066366205440:12345-192.168.201.58@tcp:33:mount.lustre.0 00000004:00200000:3.0:1782481021.275991:0:14210:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:3.0:1782481021.276168:0:14210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:13820:x1869066366205440:12345-192.168.201.58@tcp:33:mount.lustre.0 Request processed in 643us (1381us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481021.276183:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00002000:00080000:2.0:1782481021.276395:0:14842:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1782481021.281006:0:14842:0:(import.c:65:import_set_state_nolock()) ffff91d6c3354800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782481021.281179:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3baa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:2349:x1869066366205184:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 6994us (7553us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481021.281191:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782481021.281265:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1782481021.281272:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2349:x1869066366205312:12345-192.168.201.58@tcp:8:mount.lustre.0 00010000:00080000:2.0:1782481021.281320:0:14842:0:(ldlm_lib.c:1432:target_handle_connect()) lustre-OST0001: connection from b1c38af0-aec8-4f5a-b9a2-2cc36817ec45@192.168.201.58@tcp t0 exp 0000000000000000 cur 551 last 0 00000020:00000080:2.0:1782481021.281351:0:14842:0:(genops.c:1406:class_connect()) connect: client b1c38af0-aec8-4f5a-b9a2-2cc36817ec45, cookie 0x4776e02a9acf64ec 00002000:00100000:2.0:1782481021.281389:0:14842:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli b1c38af0-aec8-4f5a-b9a2-2cc36817ec45/ffff91d6c3350800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 2113662 ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1782481021.281402:0:14842:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1782481021.286120:0:14842:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1782481021.286192:0:14842:0:(import.c:65:import_set_state_nolock()) ffff91d6c3357800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1782481021.286334:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:2349:x1869066366205312:12345-192.168.201.58@tcp:8:mount.lustre.0 Request processed in 5058us (12612us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481021.286360:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1782481021.488339:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481021.488449:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366205568 00000100:00100000:3.0:1782481021.488459:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366205568 00000100:00100000:3.0:1782481021.488537:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:3.0:1782481021.488548:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:13853:x1869066366205568:12345-192.168.201.58@tcp:101:mkdir.0 00010000:00010000:3.0:1782481021.488571:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481021.488594:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf64f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a00eb expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481021.488711:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481021.488734:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481021.488749:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782481021.489116:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1782481021.489121:0:14208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1782481021.489208:0:14208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481021.489239:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf64f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00eb expref: 8 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481021.489260:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00eb expref: 7 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481021.489282:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610ba00) 00010000:00010000:3.0:1782481021.489286:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1782481021.489289:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a800, rc 0) 00000100:00100000:3.0:1782481021.490331:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e75180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+7:13853:x1869066366205568:12345-192.168.201.58@tcp:101:mkdir.0 Request processed in 1774us (1993us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481021.490342:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00010000:00010000:1.0:1782481021.599563:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481022.625370:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481023.393920:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388219648:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1782481023.394002:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481023.394832:0:14847:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388219648 00000100:00100000:2.0:1782481023.394852:0:14847:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388219648 00000100:00100000:2.0:1782481023.394937:0:14847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1782481023.394950:0:14847:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388219648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1782481023.394995:0:14847:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1782481023.395152:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1782481023.395595:0:14847:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1869066388219648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 645us (1589us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481023.395606:0:14847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1782481023.403509:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1869066388219648:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1782481023.646967:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1782481023.949935:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of b1c38af0-aec8-4f5a-b9a2-2cc36817ec45 00000001:00100000:1.0:1782481023.949952:0:5825:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 3057645e-c20b-49f1-9cb3-c94df18fd1de 00000100:00100000:1.0:1782481024.416551:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d6c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388219776:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1782481024.416623:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481024.416726:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388219776 00000100:00100000:1.0:1782481024.416733:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388219776 00000100:00100000:1.0:1782481024.416789:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1782481024.416798:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388219776:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1782481024.417022:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782481024.417033:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388220032:0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417068:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481024.417089:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782481024.417095:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388220160:0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417120:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481024.417148:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388220032 00000100:00100000:0.0:1782481024.417152:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388220032 00000100:00100000:0.0:1782481024.417181:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782481024.417187:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388220032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417245:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388220032:12345-0@lo:400:kworker.0 Request processed in 58us (176us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481024.417253:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1782481024.417276:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388220160 00000100:00100000:0.0:1782481024.417279:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388220160 00000100:00100000:0.0:1782481024.417303:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782481024.417309:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388220160:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417355:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1869066388220160:12345-0@lo:400:kworker.0 Request processed in 46us (235us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481024.417360:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1782481024.417396:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1869066388220160:0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417407:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3bb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388220032:0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417439:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388219904:0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417467:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481024.417490:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388220416:0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481024.417525:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782481024.417531:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388220288:0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417549:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481024.417571:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388219904 00000100:00100000:0.0:1782481024.417574:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388219904 00000100:00100000:0.0:1782481024.417600:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782481024.417606:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3313:x1869066388219904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417646:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14fc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3313:x1869066388219904:12345-0@lo:400:kworker.0 Request processed in 40us (177us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481024.417652:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1782481024.417701:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388220416 00000100:00100000:0.0:1782481024.417705:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388220416 00000100:00100000:0.0:1782481024.417730:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388220288 00000100:00100000:0.0:1782481024.417733:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388220288 00000100:00100000:0.0:1782481024.417749:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782481024.417754:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388220416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.417793:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1869066388220416:12345-0@lo:400:kworker.0 Request processed in 38us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481024.417799:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1782481024.417811:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1782481024.417816:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388220288:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1782481024.418239:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782481024.418279:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e77800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388219776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 1481us (1655us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481024.418286:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782481024.420979:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1869066388220288:12345-0@lo:400:kworker.0 Request processed in 3154us (3419us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481024.420992:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1782481024.421034:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782481024.422525:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1869066388220288:0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.422540:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3ba300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3313:1869066388219904:0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.422551:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7ef3b9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1869066388220416:0@lo:400:kworker.0 00000100:00100000:0.0:1782481024.422612:0:3312:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1782481024.422631:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d6c1e77b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388219776:0@lo:13:osp-pre-1-0.0 00000001:02000400:2.0:1782481024.488021:0:16076:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000001:00100000:1.0:1782481024.490725:0:7517:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of b1c38af0-aec8-4f5a-b9a2-2cc36817ec45 00000001:00100000:1.0:1782481024.491321:0:6632:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of b1c38af0-aec8-4f5a-b9a2-2cc36817ec45 00010000:00010000:0.0:1782481024.671847:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481025.698627:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481026.540600:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481026.540698:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481026.540734:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481026.540761:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481026.540796:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481026.540809:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366206208 00000100:00100000:1.0:1782481026.540818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481026.540821:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366206208 00000100:00100000:1.0:1782481026.540840:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481026.540877:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366205952 00000100:00100000:1.0:1782481026.540881:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366205952 00000100:00100000:3.0:1782481026.540890:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366205824 00000100:00100000:3.0:1782481026.540892:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366205824 00000100:00100000:1.0:1782481026.540903:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366206464 00000100:00100000:1.0:1782481026.540906:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366206464 00000100:00100000:3.0:1782481026.540910:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:1.0:1782481026.540919:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366206080 00000100:00100000:3.0:1782481026.540920:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:2350:x1869066366206208:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782481026.540921:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366206080 00000100:00100000:1.0:1782481026.540931:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366206336 00000100:00100000:1.0:1782481026.540933:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366206336 00000100:00100000:1.0:1782481026.540947:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1782481026.540952:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2350:x1869066366205952:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782481026.541000:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e76a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:2350:x1869066366206208:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 81us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481026.541009:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:0.0:1782481026.541025:0:14842:0:(service.c:3461:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1782481026.541026:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1782481026.541032:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:2351:x1869066366205824:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782481026.541036:0:14842:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1782481026.542343:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:2351:x1869066366205824:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 1303us (1549us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481026.542343:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e74a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2350:x1869066366205952:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 1377us (1631us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481026.542356:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1782481026.542361:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1782481026.542387:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1782481026.542400:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2350:x1869066366206464:12345-192.168.201.58@tcp:400:kworker.0 00000100:00080000:3.0:1782481026.542406:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782481026.542412:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782481026.542435:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782481026.542447:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e77b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2350:x1869066366206464:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 53us (1686us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481026.542454:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1782481026.542468:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1782481026.542474:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2351:x1869066366206080:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782481026.542499:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2351:x1869066366206080:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (1680us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481026.542504:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:1.0:1782481026.542515:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:1.0:1782481026.542520:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2351:x1869066366206336:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782481026.542542:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2351:x1869066366206336:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 22us (1701us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481026.542555:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:2.0:1782481026.548885:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366205696 00000100:00100000:2.0:1782481026.548903:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366205696 00000100:00100000:2.0:1782481026.548972:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 106 00000100:00100000:2.0:1782481026.548982:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:2350:x1869066366205696:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782481026.549085:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:2350:x1869066366205696:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 103us (8497us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481026.549094:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 106 00010000:00010000:2.0:1782481026.719474:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481027.748453:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1782481028.444141:0:16228:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff6a6a9430 20000000:00000080:0.0:1782481028.444160:0:16228:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff91d6c28c8800 uarg=0000000000000000 20000000:01000000:0.0:1782481028.444198:0:16228:0:(mgs_llog.c:6177:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782481028.444204:0:16228:0:(mgs_llog.c:4638:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1782481028.444209:0:16228:0:(mgs_llog.c:1376:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1782481028.445458:0:16229:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:0.0:1782481028.445621:0:16228:0:(mgs_llog.c:1447:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:0.0:1782481028.452577:0:16228:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1782481028.453230:0:16228:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453249:0:16228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d6c297b000/0x4776e02a9acf61f8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf61f1 expref: 18 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453258:0:16228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7c779aa00/0x4776e02a9acf6245 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf623e expref: 18 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453264:0:16228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d802059c00/0x4776e02a9acf6379 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6372 expref: 18 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453274:0:16228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf649f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a005f expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453280:0:16228:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff91d7fee2d800/0x4776e02a9acf64d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00c1 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453288:0:16228:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453333:0:16228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7fee2d800/0x4776e02a9acf64d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00c1 expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453346:0:16228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d7fee2d800/0x4776e02a9acf64d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00c1 expref: 12 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481028.453363:0:16228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869066388220544:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782481028.453488:0:16228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf649f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a005f expref: 12 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453497:0:16228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf649f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a005f expref: 12 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481028.453508:0:16228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869066388220672:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782481028.453539:0:16228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d802059c00/0x4776e02a9acf6379 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf6372 expref: 18 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453547:0:16228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d802059c00/0x4776e02a9acf6379 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf6372 expref: 18 pid: 14200 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481028.453557:0:16228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869066388220800:0@lo:104: 00000100:00100000:1.0:1782481028.453597:0:16228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782481028.453640:0:16228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d7c779aa00/0x4776e02a9acf6245 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf623e expref: 18 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.453649:0:16228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d7c779aa00/0x4776e02a9acf6245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf623e expref: 18 pid: 14200 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481028.453686:0:16228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869066388220928:0@lo:104: 00000100:00100000:1.0:1782481028.454592:0:16228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1782481028.454647:0:16228:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff91d6c297b000/0x4776e02a9acf61f8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x4776e02a9acf61f1 expref: 18 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.454792:0:16228:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff91d6c297b000/0x4776e02a9acf61f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x4776e02a9acf61f1 expref: 18 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481028.454795:0:14191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388220800 00000100:00100000:3.0:1782481028.454804:0:14191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388220800 00000100:00100000:1.0:1782481028.454805:0:16228:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869066388221056:0@lo:104: 00000100:00100000:1.0:1782481028.454851:0:16228:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481028.454866:0:16228:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c50180c0 going to sleep for 11 seconds 00000100:00100000:3.0:1782481028.454905:0:14191:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1782481028.454918:0:14191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388220928 00000100:00100000:3.0:1782481028.454921:0:14191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388220928 00000100:00100000:3.0:1782481028.454933:0:14191:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388221056 00000100:00100000:3.0:1782481028.454936:0:14191:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388221056 00000100:00100000:3.0:1782481028.454950:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782481028.454958:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+5:16228:x1869066388220800:12345-0@lo:104: 00010000:00010000:3.0:1782481028.454971:0:14191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455038:0:14191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1782481028.455044:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+5:16228:x1869066388220800:12345-0@lo:104: Request processed in 87us (1447us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481028.455051:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782481028.455069:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782481028.455075:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+4:16228:x1869066388220928:12345-0@lo:104: 00010000:00010000:3.0:1782481028.455083:0:14191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481028.455121:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1782481028.455127:0:14191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1782481028.455131:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481028.455132:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+4:16228:x1869066388220928:12345-0@lo:104: Request processed in 58us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481028.455138:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1782481028.455139:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779bc00 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:2.0:1782481028.455143:0:14195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481028.455149:0:14191:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782481028.455155:0:14191:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df558c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+3:16228:x1869066388221056:12345-0@lo:104: 00010000:00010000:3.0:1782481028.455161:0:14191:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481028.455164:0:14195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782481028.455172:0:14195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1782481028.455178:0:14195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782481028.455196:0:14191:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1782481028.455201:0:14191:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df558c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+3:16228:x1869066388221056:12345-0@lo:104: Request processed in 47us (351us total) trans 0 rc 0/0 00010000:00010000:2.0:1782481028.455205:0:14195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481028.455207:0:14191:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:2.0:1782481028.455212:0:14195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782481028.455229:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481028.455235:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7c779bc00/0x4776e02a9acf6372 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf6379 expref: -99 pid: 15515 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455241:0:15804:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1782481028.455245:0:15804:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481028.455245:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481028.455248:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455252:0:15804:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e200 already unused, calling callback (ffffffffc1a6ac20) 00010000:00010000:2.0:1782481028.455254:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7ef55e600 already unused, calling callback (ffffffffc1a6ac20) 10000000:00010000:3.0:1782481028.455255:0:15804:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782481028.455257:0:14195:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455262:0:15804:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481028.455263:0:14195:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1782481028.455270:0:15804:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1782481028.455270:0:14195:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1782481028.455275:0:15804:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:2.0:1782481028.455280:0:14195:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1782481028.455288:0:15804:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481028.455290:0:14195:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455295:0:15804:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1782481028.455296:0:14195:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1782481028.455301:0:15804:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455307:0:15804:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e200/0x4776e02a9acf623e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf6245 expref: -99 pid: 14841 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481028.455308:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481028.455315:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.201.158@tcp lock: ffff91d7ef55e600/0x4776e02a9acf61f1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x4776e02a9acf61f8 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481028.455324:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481028.455326:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481028.455327:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481028.455328:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481028.455329:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481028.455330:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1782481028.455343:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481028.455388:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388221184:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782481028.455420:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481028.455449:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1782481028.455455:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7efe70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388221312:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782481028.455477:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481028.455512:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3312:1869066388221440:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1782481028.455535:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481028.455580:0:14193:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388221184 00000100:00100000:0.0:1782481028.455584:0:14193:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388221184 00000100:00100000:3.0:1782481028.455594:0:14192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388221312 00000100:00100000:3.0:1782481028.455598:0:14192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388221312 00010000:00010000:0.0:1782481028.455603:0:14193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d802059c00/0x4776e02a9acf6379 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf6372 expref: 20 pid: 14200 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455609:0:14192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7c779aa00/0x4776e02a9acf6245 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf623e expref: 20 pid: 14200 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481028.455616:0:14193:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388221440 00000100:00100000:0.0:1782481028.455618:0:14193:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388221440 00000100:00100000:3.0:1782481028.455621:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782481028.455626:0:14192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+21:3310:x1869066388221184:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1782481028.455627:0:14193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d6c297b000/0x4776e02a9acf61f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf61f1 expref: 21 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455636:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1782481028.455637:0:14193:0:(service.c:3461:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:3.0:1782481028.455640:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d802059c00/0x4776e02a9acf6379 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf6372 expref: 21 pid: 14200 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481028.455642:0:14193:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1782481028.455649:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d802059c00/0x4776e02a9acf6379 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf6372 expref: 21 pid: 14200 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455684:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481028.455715:0:14192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+21:3310:x1869066388221184:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481028.455720:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1782481028.455734:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782481028.455738:0:14192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+20:3310:x1869066388221312:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481028.455745:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481028.455748:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7c779aa00/0x4776e02a9acf6245 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf623e expref: 20 pid: 14200 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455769:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7c779aa00/0x4776e02a9acf6245 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf623e expref: 20 pid: 14200 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455785:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481028.455807:0:14192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+20:3310:x1869066388221312:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481028.455813:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1782481028.455825:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782481028.455831:0:14192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fef1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3312:x1869066388221440:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1782481028.455838:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481028.455842:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d6c297b000/0x4776e02a9acf61f8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x4776e02a9acf61f1 expref: 19 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455850:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d6c297b000/0x4776e02a9acf61f8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x4776e02a9acf61f1 expref: 19 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.455858:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481028.455880:0:14192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fef1c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3312:x1869066388221440:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (344us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481028.455886:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1782481028.455938:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7efe70a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388221312:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481028.455949:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388221184:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1782481028.455974:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3312:1869066388221440:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1782481028.456533:0:16228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d802059c00/0x4776e02a9acf6379 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf6372 expref: 18 pid: 14200 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481028.456547:0:16228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bed80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869066388220800:0@lo:104: 00010000:00010000:1.0:1782481028.456556:0:16228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7c779aa00/0x4776e02a9acf6245 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf623e expref: 17 pid: 14200 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481028.456563:0:16228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006be300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869066388220928:0@lo:104: 00010000:00010000:1.0:1782481028.456571:0:16228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297b000/0x4776e02a9acf61f8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x4776e02a9acf61f1 expref: 16 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481028.456580:0:16228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bdc00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869066388221056:0@lo:104: 00000100:00100000:3.0:1782481028.462078:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481028.462247:0:14193:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366206592 00000100:00100000:0.0:1782481028.462265:0:14193:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366206592 00010000:00010000:0.0:1782481028.462315:0:14193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d7fee2d800/0x4776e02a9acf64d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00c1 expref: 13 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481028.462370:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1782481028.462381:0:14193:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:2351:x1869066366206592:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782481028.462397:0:14193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782481028.462402:0:14193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d7fee2d800/0x4776e02a9acf64d7 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00c1 expref: 13 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481028.462789:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481028.462822:0:14192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366206720 00000100:00100000:3.0:1782481028.462830:0:14192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366206720 00010000:00010000:3.0:1782481028.462868:0:14192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf649f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a005f expref: 14 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481028.462920:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:3.0:1782481028.462929:0:14192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+14:2350:x1869066366206720:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782481028.462943:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481028.462949:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf649f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a005f expref: 14 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.463097:0:14193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d7fee2d800/0x4776e02a9acf64d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00c1 expref: 14 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481028.463327:0:16228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869066388220544:192.168.201.58@tcp:104: 00000100:00100000:1.0:1782481028.463356:0:16228:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16228:1869066388220672:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782481028.463909:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf649f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a005f expref: 14 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.463938:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf649f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a005f expref: 14 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481028.463958:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1782481028.464047:0:14192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:2350:x1869066366206720:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 1117us (1261us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481028.464057:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00010000:00010000:0.0:1782481028.468382:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d7fee2d800/0x4776e02a9acf64d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00c1 expref: 12 pid: 14201 timeout: 659 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.468416:0:14193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.468443:0:14193:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.468475:0:14193:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.468483:0:14193:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.468490:0:14193:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.468498:0:14193:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.468505:0:14193:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2092800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481028.468511:0:14193:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.468520:0:14193:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.468558:0:14193:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481028.468575:0:14193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782481028.468689:0:14193:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:2351:x1869066366206592:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 6278us (6596us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481028.468701:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00010000:00010000:1.0:1782481028.469098:0:16228:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.469182:0:16228:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.469191:0:16228:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481028.469199:0:16228:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff91d6c2092800/0x4776e02a9acf6501 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16228 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481028.511303:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782481028.511330:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388221568:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782481028.511406:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481028.511520:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388221568 00000100:00100000:1.0:1782481028.511543:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388221568 00000100:00100000:1.0:1782481028.511617:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782481028.511628:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388221568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782481028.511694:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782481028.511747:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388221568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (341us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481028.511765:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1782481028.511810:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388221568:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782481028.511924:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782481028.768012:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481029.545900:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388221696:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.545971:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.546021:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388222208:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.546047:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.546073:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782481029.546078:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388221824:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.546102:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.546118:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388222336:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.546220:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.546250:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388221952:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.546272:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.546291:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782481029.546296:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388222080:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.546315:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.546346:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388221696 00000100:00100000:0.0:1782481029.546353:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388221696 00000100:00100000:0.0:1782481029.546397:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782481029.546405:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:3310:x1869066388221696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.546463:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:3310:x1869066388221696:12345-0@lo:400:kworker.0 Request processed in 59us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.546470:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1782481029.546501:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388222208 00000100:00100000:0.0:1782481029.546505:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388222208 00000100:00100000:0.0:1782481029.546528:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388222336 00000100:00100000:0.0:1782481029.546531:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388222336 00000100:00100000:0.0:1782481029.546544:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388222080 00000100:00100000:0.0:1782481029.546546:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388222080 00000100:00100000:0.0:1782481029.547235:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782481029.547251:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388222208:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.547300:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388222208:12345-0@lo:400:kworker.0 Request processed in 56us (1253us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.547308:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1782481029.547325:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782481029.547331:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388222336:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.547358:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388222336:12345-0@lo:400:kworker.0 Request processed in 28us (1138us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.547363:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1782481029.547374:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782481029.547378:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388222080:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.547407:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388222080:12345-0@lo:400:kworker.0 Request processed in 28us (1091us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.547413:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1782481029.547431:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388221824 00000100:00100000:0.0:1782481029.547436:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388221824 00000100:00100000:0.0:1782481029.547463:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388221952 00000100:00100000:0.0:1782481029.547475:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388221952 00000100:00100000:0.0:1782481029.547501:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782481029.547507:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388221824:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.547536:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388221824:12345-0@lo:400:kworker.0 Request processed in 30us (1434us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.547541:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1782481029.547551:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782481029.547556:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388221952:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.549431:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388221952:12345-0@lo:400:kworker.0 Request processed in 1870us (3153us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.549442:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1782481029.549522:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388221824:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.549536:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388222336:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.549546:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388221696:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.550426:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388222208:0@lo:400:kworker.0 00000100:00080000:0.0:1782481029.550475:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1782481029.550482:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782481029.550512:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388222464:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782481029.552698:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.552784:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388222080:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.552797:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388221952:0@lo:400:kworker.0 00000100:00100000:0.0:1782481029.552869:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388222464 00000100:00100000:0.0:1782481029.552876:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388222464 00000100:00100000:0.0:1782481029.552918:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782481029.552940:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388222464:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782481029.552978:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782481029.553038:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388222464:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (2464us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.553045:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1782481029.553082:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388222464:0@lo:13:osp-pre-1-0.0 10000000:01000000:1.0:1782481029.601855:0:14204:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1782481029.601863:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7df543000 from 10 10000000:01000000:1.0:1782481029.601869:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1782481029.601916:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c2093400/0x4776e02a9acf6508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481029.601928:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d6c2093400/0x4776e02a9acf6508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481029.601939:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d6c2093400/0x4776e02a9acf6508 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481029.601963:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d8006bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388222592:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1782481029.602026:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481029.602065:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c50180c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782481029.602235:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388222592 00000100:00100000:0.0:1782481029.602243:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388222592 00000100:00100000:0.0:1782481029.602299:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782481029.602308:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+16:14204:x1869066388222592:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481029.602322:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481029.602336:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297b200/0x4776e02a9acf650f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6508 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.602358:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297b200/0x4776e02a9acf650f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6508 expref: 17 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.602368:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297b200/0x4776e02a9acf650f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6508 expref: 17 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.602377:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b200, rc 0) 00000100:00100000:0.0:1782481029.605980:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:14204:x1869066388222592:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 3663us (3944us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.605993:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1782481029.606077:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d8006bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388222592:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481029.606100:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d6c2093400/0x4776e02a9acf6508 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf650f expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.606539:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d6c2093400/0x4776e02a9acf6508 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf650f expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481029.606625:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388222720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.606696:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.606720:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67ad300 going to sleep for 11 seconds 00000100:00100000:2.0:1782481029.607697:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388222720 00000100:00100000:2.0:1782481029.607708:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388222720 00000100:00100000:2.0:1782481029.607768:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1782481029.607777:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:14204:x1869066388222720:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782481029.608054:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:14204:x1869066388222720:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 277us (1356us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481029.608062:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:0.0:1782481029.608249:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388222720:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.608291:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388222848:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.608333:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.608355:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67ad300 going to sleep for 11 seconds 00000100:00100000:2.0:1782481029.608380:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388222848 00000100:00100000:2.0:1782481029.608385:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388222848 00000100:00100000:2.0:1782481029.608419:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1782481029.608425:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:14204:x1869066388222848:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782481029.608704:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:14204:x1869066388222848:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 278us (369us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481029.608711:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1782481029.609307:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b6680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388222848:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1782481029.610708:0:16257:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782481029.610866:0:14204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782481029.610886:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782481029.610897:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c2093400/0x4776e02a9acf6508 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf650f expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.610908:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d6c2093400/0x4776e02a9acf6508 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf650f expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481029.610918:0:14204:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782481029.610921:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7c52ce800 from 10 10000000:01000000:0.0:1782481029.610923:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782481029.610956:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b800/0x4776e02a9acf6516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.610964:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d6c297b800/0x4776e02a9acf6516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.610990:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d6c297b800/0x4776e02a9acf6516 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481029.611016:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388222976:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.611079:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.611120:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67ad240 going to sleep for 11 seconds 00000100:00100000:3.0:1782481029.611940:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388222976 00000100:00100000:3.0:1782481029.611949:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388222976 00000100:00100000:3.0:1782481029.611997:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1782481029.612007:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+17:14204:x1869066388222976:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1782481029.612022:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481029.612036:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7c779a600/0x4776e02a9acf651d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6516 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481029.612074:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7c779a600/0x4776e02a9acf651d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6516 expref: 18 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481029.612084:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7c779a600/0x4776e02a9acf651d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6516 expref: 18 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481029.612094:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a600, rc 0) 00000100:00100000:3.0:1782481029.612157:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:14204:x1869066388222976:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (1077us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481029.612164:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1782481029.612189:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388222976:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782481029.612203:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d6c297b800/0x4776e02a9acf6516 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf651d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481029.612211:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d6c297b800/0x4776e02a9acf6516 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf651d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481029.612269:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388223104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782481029.612298:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481029.612329:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782481029.612481:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388223104 00000100:00100000:0.0:1782481029.612485:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388223104 00000100:00100000:0.0:1782481029.612512:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1782481029.612518:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fb14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:14204:x1869066388223104:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.612793:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fb14e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:14204:x1869066388223104:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 274us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.612800:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1782481029.612831:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388223104:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1782481029.612862:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388223232:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1782481029.612897:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481029.612913:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7df495a80 going to sleep for 11 seconds 00000100:00100000:0.0:1782481029.614235:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388223232 00000100:00100000:0.0:1782481029.614245:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388223232 00000100:00100000:0.0:1782481029.614290:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1782481029.614300:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:14204:x1869066388223232:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.614502:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0c450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:14204:x1869066388223232:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 203us (1603us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.614508:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1782481029.614678:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388223232:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1782481029.616359:0:16258:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782481029.616492:0:14204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782481029.616514:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782481029.616525:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297b800/0x4776e02a9acf6516 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf651d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.616535:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d6c297b800/0x4776e02a9acf6516 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf651d expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1782481029.616553:0:14204:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1782481029.616555:0:14204:0:(mgc_request.c:1803:mgc_process_log()) Process log params-ffff91d7fe76b000 from 10 10000000:01000000:0.0:1782481029.616558:0:14204:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1782481029.616593:0:14204:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf6524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.616601:0:14204:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf6524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.616612:0:14204:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf6524 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481029.616636:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388223360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.617253:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.617296:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67add80 going to sleep for 11 seconds 00000100:00100000:2.0:1782481029.618694:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388223360 00000100:00100000:2.0:1782481029.618705:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388223360 00000100:00100000:2.0:1782481029.618774:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1782481029.618784:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+18:14204:x1869066388223360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782481029.618814:0:14201:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481029.618833:0:14201:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2dc00/0x4776e02a9acf652b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x4776e02a9acf6524 expref: -99 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481029.618865:0:14201:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2dc00/0x4776e02a9acf652b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x4776e02a9acf6524 expref: 19 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481029.618877:0:14201:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2dc00/0x4776e02a9acf652b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x4776e02a9acf6524 expref: 19 pid: 14201 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481029.618885:0:14201:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2dc00, rc 0) 00000100:00100000:2.0:1782481029.618951:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:14204:x1869066388223360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (1699us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481029.618957:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:0.0:1782481029.621235:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388223360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481029.621265:0:14204:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf6524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf652b expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.621278:0:14204:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf6524 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x4776e02a9acf652b expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481029.621365:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388223488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.621442:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.621486:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67add80 going to sleep for 11 seconds 00000100:00100000:0.0:1782481029.621508:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388223488 00000100:00100000:0.0:1782481029.621515:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388223488 00000100:00100000:0.0:1782481029.621574:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782481029.621583:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:14204:x1869066388223488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.621891:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:14204:x1869066388223488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 308us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.621899:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:0.0:1782481029.621940:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388223488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.621970:0:14204:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388223616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.622006:0:14204:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481029.622020:0:14204:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c67add80 going to sleep for 11 seconds 00000100:00100000:0.0:1782481029.622031:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388223616 00000100:00100000:0.0:1782481029.622034:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388223616 00000100:00100000:0.0:1782481029.622054:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782481029.622060:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:14204:x1869066388223616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481029.622194:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:14204:x1869066388223616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 133us (187us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481029.622201:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:0.0:1782481029.622238:0:14204:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:14204:1869066388223616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:0.0:1782481029.622943:0:16260:0:(llog.c:857:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1782481029.623004:0:14204:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1782481029.623018:0:14204:0:(mgc_request.c:1880:mgc_process_log()) MGC192.168.201.158@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1782481029.623028:0:14204:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf6524 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf652b expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481029.623038:0:14204:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.201.158@tcp lock: ffff91d6c297ba00/0x4776e02a9acf6524 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x4776e02a9acf652b expref: -99 pid: 14204 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481029.790975:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481030.123743:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481030.123883:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366206848 00000100:00100000:2.0:1782481030.123894:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366206848 00000100:00100000:2.0:1782481030.123958:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:2.0:1782481030.123969:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+11:13708:x1869066366206848:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1782481030.123988:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481030.124006:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf6532 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d9a00f2 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481030.124035:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf6532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00f2 expref: 12 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481030.124046:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d7fee2d600/0x4776e02a9acf6532 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00f2 expref: 12 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481030.124055:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d600, rc 0) 00000100:00100000:2.0:1782481030.124133:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0d050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+12:13708:x1869066366206848:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 166us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481030.124141:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 117 00000100:00100000:3.0:1782481030.126933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481030.127040:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366206976 00000100:00100000:0.0:1782481030.127049:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366206976 00000100:00100000:0.0:1782481030.127096:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:0.0:1782481030.127105:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+12:13708:x1869066366206976:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481030.127414:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+12:13708:x1869066366206976:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 308us (489us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481030.127422:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 118 00000100:00100000:2.0:1782481030.132582:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481030.132970:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366207104 00000100:00100000:3.0:1782481030.132981:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366207104 00000100:00100000:3.0:1782481030.133059:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:3.0:1782481030.133070:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+12:13708:x1869066366207104:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1782481030.133314:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+12:13708:x1869066366207104:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 244us (755us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481030.133323:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 119 00000100:00100000:3.0:1782481030.152078:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481030.152621:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366207232 00000100:00100000:0.0:1782481030.152640:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366207232 00000100:00100000:0.0:1782481030.152720:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:0.0:1782481030.152739:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+12:13708:x1869066366207232:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1782481030.152757:0:14200:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481030.152774:0:14200:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf6539 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x905acca49d9a00f9 expref: -99 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481030.152800:0:14200:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf6539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00f9 expref: 13 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481030.152811:0:14200:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff91d6c297a000/0x4776e02a9acf6539 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00f9 expref: 13 pid: 14200 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481030.152821:0:14200:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a000, rc 0) 00000100:00100000:0.0:1782481030.152876:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13708:x1869066366207232:12345-192.168.201.58@tcp:101:ll_cfg_requeue.0 Request processed in 139us (809us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481030.152884:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 120 00000100:00100000:3.0:1782481030.156519:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481030.157259:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366207360 00000100:00100000:0.0:1782481030.157269:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366207360 00000100:00100000:0.0:1782481030.157326:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:0.0:1782481030.157337:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13708:x1869066366207360:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1782481030.157621:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13708:x1869066366207360:12345-192.168.201.58@tcp:501:ll_cfg_requeue.0 Request processed in 286us (1110us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481030.157630:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 121 00000100:00100000:3.0:1782481030.160017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481030.162308:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366207488 00000100:00100000:0.0:1782481030.162324:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366207488 00000100:00100000:0.0:1782481030.162383:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 122 00000100:00100000:0.0:1782481030.162393:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13708:x1869066366207488:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1782481030.162617:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0e450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:13708:x1869066366207488:12345-192.168.201.58@tcp:503:ll_cfg_requeue.0 Request processed in 224us (2609us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481030.162626:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 122 00000040:00080000:1.0:1782481030.304066:0:14240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1782481030.819001:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481031.681407:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481031.681442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481031.681474:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481031.681504:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481031.681518:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481031.681532:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481031.681548:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481031.681778:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366207744 00000100:00100000:2.0:1782481031.681789:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366207744 00000100:00100000:2.0:1782481031.681849:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366208128 00000100:00100000:2.0:1782481031.681852:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366208128 00000100:00100000:2.0:1782481031.681871:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:2.0:1782481031.681881:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:2350:x1869066366207744:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782481031.681956:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe72300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:2350:x1869066366207744:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 77us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481031.681964:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:2.0:1782481031.681982:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:2.0:1782481031.681989:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:2351:x1869066366208128:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782481031.682035:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:2351:x1869066366208128:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 46us (501us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481031.682042:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:2.0:1782481031.682060:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366208000 00000100:00100000:2.0:1782481031.682063:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366208000 00000100:00100000:2.0:1782481031.682082:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366208256 00000100:00100000:2.0:1782481031.682084:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366208256 00000100:00100000:2.0:1782481031.682096:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366207872 00000100:00100000:2.0:1782481031.682099:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366207872 00000100:00100000:2.0:1782481031.682124:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366208384 00000100:00100000:2.0:1782481031.682127:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366208384 00000100:00100000:2.0:1782481031.682145:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782481031.682152:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2350:x1869066366208000:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782481031.682189:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe71500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2350:x1869066366208000:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 37us (713us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481031.682196:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782481031.682208:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1782481031.682215:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2350:x1869066366208256:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782481031.682238:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e74e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2350:x1869066366208256:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 24us (733us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481031.682244:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1782481031.682256:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1782481031.682262:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2351:x1869066366207872:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782481031.682286:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2351:x1869066366207872:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (767us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481031.682292:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1782481031.682302:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:2.0:1782481031.682308:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2351:x1869066366208384:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782481031.682334:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2351:x1869066366208384:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481031.682340:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1782481031.682941:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366207616 00000100:00100000:0.0:1782481031.682949:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366207616 00000100:00100000:0.0:1782481031.682991:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00100000:0.0:1782481031.683012:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:2351:x1869066366207616:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:0.0:1782481031.683070:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:2351:x1869066366207616:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 59us (1673us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481031.683076:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 123 00000100:00080000:3.0:1782481031.683574:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1782481031.683581:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1782481031.683584:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1782481031.839282:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1782481032.623834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481032.623959:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366208512 00000100:00100000:2.0:1782481032.623972:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366208512 00000100:00100000:2.0:1782481032.624039:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:2.0:1782481032.624050:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ff0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:14364:x1869066366208512:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782481032.624085:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481032.624106:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf6540 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0100 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.624182:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf6547 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.624198:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf6547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.624211:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf6547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.624228:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf654e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.624235:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf654e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.624241:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf654e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625142:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf6555 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625157:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf6555 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625166:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf6555 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481032.625248:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1782481032.625256:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1782481032.625345:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf6555 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625360:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf6547 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625366:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf6547 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625374:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf6547 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625380:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2c000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782481032.625385:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf6547 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625393:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf6547 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625409:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610ba00) 00010000:00010000:2.0:1782481032.625412:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481032.625417:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf6547 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625424:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf6547 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625436:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf654e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625443:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf654e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625459:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf654e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625465:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782481032.625468:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf654e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625475:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf654e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625482:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff91d7c610b200) 00010000:00010000:2.0:1782481032.625485:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481032.625488:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf654e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.625494:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf654e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.628026:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf6540 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0100 expref: 8 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.628062:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d800/0x4776e02a9acf6555 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0100 expref: 7 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.628071:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d7c610b700) 00010000:00010000:2.0:1782481032.628074:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782481032.628077:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2d800, rc 0) 00000100:00100000:2.0:1782481032.628242:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ff0b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:14364:x1869066366208512:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 4192us (4421us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481032.628269:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 15 00000100:00100000:2.0:1782481032.646446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481032.646761:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366208768 00000100:00100000:0.0:1782481032.646772:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366208768 00000100:00100000:0.0:1782481032.646833:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1782481032.646843:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:14364:x1869066366208768:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782481032.646882:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481032.646904:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf655c lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0107 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.646997:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf6563 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647013:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf6563 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647026:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf6563 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647082:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf656a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647089:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf656a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647096:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf656a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647566:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf6571 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647576:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf6571 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647584:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf6571 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782481032.647593:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1782481032.647903:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf6563 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647911:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf6563 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647917:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf6563 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647923:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481032.647927:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf6563 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647935:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf6563 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647946:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff91d7c610b700) 00010000:00010000:0.0:1782481032.647949:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481032.647953:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf6563 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647960:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf6563 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647971:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf656a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647978:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf656a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647983:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf656a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.647998:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481032.648001:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf656a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.648007:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf656a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.648015:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff91d7c32f3900) 00010000:00010000:0.0:1782481032.648018:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481032.648020:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf656a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.648025:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf656a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.648393:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf655c lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0107 expref: 10 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.648411:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b400/0x4776e02a9acf6571 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0107 expref: 9 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.648418:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c32f3200) 00010000:00010000:0.0:1782481032.648421:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481032.648423:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b400, rc 0) 00000100:00100000:0.0:1782481032.648492:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+9:14364:x1869066366208768:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1649us (2059us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1782481032.648501:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:0.0:1782481032.655177:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481032.657037:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366208896 00000100:00100000:2.0:1782481032.657056:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366208896 00000100:00100000:2.0:1782481032.657126:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1782481032.657137:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+9:14364:x1869066366208896:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1782481032.657264:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+9:14364:x1869066366208896:12345-192.168.201.58@tcp:59:lhsmtool_posix.0 Request processed in 128us (2097us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481032.657271:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1782481032.678990:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481032.679099:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366209024 00000100:00100000:1.0:1782481032.679110:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366209024 00000100:00100000:1.0:1782481032.679177:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1782481032.679188:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+9:14370:x1869066366209024:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782481032.679227:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481032.679257:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf657f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a010e expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679336:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf6586 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679352:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf6586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679365:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf6586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679381:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf658d lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679388:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf658d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679394:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf658d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679646:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf6586 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679654:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf6586 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679701:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf6586 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679707:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2092400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782481032.679717:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf6586 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679725:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf6586 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679738:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610ba00) 00010000:00010000:1.0:1782481032.679741:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481032.679746:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf6586 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679753:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf6586 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679765:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf658d lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679770:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf658d lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679776:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf658d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679782:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2093e00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782481032.679785:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf658d lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679790:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf658d lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679796:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91d7c51d1100) 00010000:00010000:1.0:1782481032.679798:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481032.679805:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf658d lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679812:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf658d lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679845:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf657f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a010e expref: 10 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679854:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610ba00) 00010000:00010000:1.0:1782481032.679857:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481032.679860:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf657f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a010e expref: 10 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.679868:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c2093a00, rc 0) 00000100:00100000:1.0:1782481032.679933:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+9:14370:x1869066366209024:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 747us (953us total) trans 0 rc 301/301 00000100:00100000:1.0:1782481032.679940:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:3.0:1782481032.686857:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481032.686961:0:14215:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366209152 00000100:00100000:1.0:1782481032.686971:0:14215:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366209152 00000100:00100000:1.0:1782481032.687021:0:14215:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1782481032.687030:0:14215:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3057645e-c20b-49f1-9cb3-c94df18fd1de+9:14370:x1869066366209152:12345-192.168.201.58@tcp:700:lfs.0 00000100:00100000:1.0:1782481032.687105:0:14215:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:3057645e-c20b-49f1-9cb3-c94df18fd1de+9:14370:x1869066366209152:12345-192.168.201.58@tcp:700:lfs.0 Request processed in 76us (257us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481032.687113:0:14215:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1782481032.689330:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481032.689436:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366209408 00000100:00100000:0.0:1782481032.689445:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366209408 00000100:00100000:0.0:1782481032.689500:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:0.0:1782481032.689510:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+9:14370:x1869066366209408:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:0.0:1782481032.689580:0:14208:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782481032.689607:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf64c2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0089 expref: 9 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.689628:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610ba00) 00010000:00010000:0.0:1782481032.689633:0:14208:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782481032.690046:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.690073:0:14208:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00eb expref: 5 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.690082:0:14208:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.690116:0:14208:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00eb expref: 5 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.690130:0:14208:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00eb expref: 5 pid: 14208 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481032.690145:0:14208:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14208:1869066388223744:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782481032.690235:0:14208:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c622ee40 going to sleep for 11 seconds 00000100:00100000:3.0:1782481032.693417:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481032.693570:0:14208:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14208:1869066388223744:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782481032.693616:0:14208:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481032.694292:0:16230:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366209536 00000100:00100000:2.0:1782481032.694303:0:16230:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366209536 00010000:00010000:2.0:1782481032.694343:0:16230:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00eb expref: 6 pid: 14208 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481032.694425:0:16230:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:2.0:1782481032.694445:0:16230:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:2351:x1869066366209536:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481032.694463:0:16230:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481032.694470:0:16230:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00eb expref: 6 pid: 14208 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.694482:0:16230:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00eb expref: 6 pid: 14208 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.694505:0:16230:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf64fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a00eb expref: 6 pid: 14208 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.694548:0:16230:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610ba00) 00010000:00010000:2.0:1782481032.694553:0:16230:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.694563:0:16230:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.694570:0:16230:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.694637:0:16230:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481032.694725:0:16230:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7a300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2351:x1869066366209536:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 281us (1319us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481032.694733:0:16230:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00010000:00010000:1.0:1782481032.695504:0:14208:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.695512:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.695551:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.695562:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.695571:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782481032.697221:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782481032.697242:0:14208:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.697250:0:14208:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.697257:0:14208:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.697263:0:14208:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782481032.697268:0:14208:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.697276:0:14208:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.697294:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610ba00) 00010000:00010000:1.0:1782481032.697299:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481032.697304:0:14208:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.697322:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6594 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782481032.697352:0:14208:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000fc87c5bc reply state 00000000fb67aa6c transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481032.697362:0:14208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782481032.697516:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+10:14370:x1869066366209408:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 8003us (8194us total) trans 8589934594 rc 0/0 00000100:00100000:1.0:1782481032.697525:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00010000:00010000:3.0:1782481032.698950:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.698962:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.698967:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.698970:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2093a00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782481032.698973:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.698979:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.698990:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91d7c51d1100) 00010000:00010000:3.0:1782481032.698992:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782481032.699004:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.699008:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093a00/0x4776e02a9acf659b lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481032.790453:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481032.791127:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366209664 00000100:00100000:2.0:1782481032.791161:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366209664 00000100:00100000:2.0:1782481032.791266:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:2.0:1782481032.791277:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+9:14377:x1869066366209664:12345-192.168.201.58@tcp:101:lctl.0 00010000:00010000:2.0:1782481032.791716:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481032.791819:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf65a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0115 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.791890:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf65a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.791904:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf65a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.791931:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf65a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481032.792001:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1782481032.792005:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:2.0:1782481032.792042:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf65a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.792070:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf65a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0115 expref: 11 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.792090:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c600/0x4776e02a9acf65a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0115 expref: 10 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.792099:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:2.0:1782481032.792102:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782481032.792106:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2c600, rc 0) 00000100:00100000:2.0:1782481032.792181:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+10:14377:x1869066366209664:12345-192.168.201.58@tcp:101:lctl.0 Request processed in 905us (1736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481032.792189:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 20 00000100:00100000:2.0:1782481032.843470:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481032.843645:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366209792 00000100:00100000:1.0:1782481032.843704:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366209792 00000100:00100000:1.0:1782481032.843755:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:1.0:1782481032.843765:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:14379:x1869066366209792:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782481032.843787:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481032.843808:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf65b0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a011c expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.843868:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf65b7 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.843881:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf65b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.843892:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf65b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782481032.844104:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1782481032.844109:0:14208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:1.0:1782481032.844152:0:14208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf65b7 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.844178:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093e00/0x4776e02a9acf65b0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a011c expref: 7 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.844197:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092400/0x4776e02a9acf65b7 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a011c expref: 6 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.844206:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:1.0:1782481032.844209:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1782481032.844213:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c2092400, rc 0) 00000100:00100000:1.0:1782481032.844279:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ff800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:14379:x1869066366209792:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 515us (818us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481032.844286:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 21 00000100:00100000:3.0:1782481032.849301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481032.849403:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366209920 00000100:00100000:2.0:1782481032.849415:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366209920 00000100:00100000:2.0:1782481032.849608:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:2.0:1782481032.849623:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:14379:x1869066366209920:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1782481032.849643:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481032.849691:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf65be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0123 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.849786:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf65c5 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.849801:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf65c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.849815:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf65c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.849830:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf65cc lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.849837:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf65cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.849844:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf65cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850217:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf65d3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850227:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf65d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850235:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf65d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481032.850280:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782481032.850284:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782481032.850313:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf65d3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850337:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf65c5 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850343:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf65c5 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850349:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf65c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850355:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2c200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782481032.850360:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf65c5 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850367:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf65c5 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850379:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:2.0:1782481032.850382:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481032.850387:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf65c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850393:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c200/0x4776e02a9acf65c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850406:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf65cc lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850411:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf65cc lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850416:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf65cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850500:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7fee2d400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782481032.850503:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf65cc lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850509:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf65cc lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850577:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91d7c610b000) 00010000:00010000:2.0:1782481032.850580:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481032.850583:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf65cc lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850589:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2d400/0x4776e02a9acf65cc lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850621:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2c000/0x4776e02a9acf65be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0123 expref: 8 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850633:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf65d3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0123 expref: 7 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.850639:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:2.0:1782481032.850642:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782481032.850644:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7fee2ca00, rc 0) 00000100:00100000:2.0:1782481032.851185:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+7:14379:x1869066366209920:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1561us (1889us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481032.851195:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 22 00000100:00100000:3.0:1782481032.855153:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481032.855212:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366210176 00000100:00100000:1.0:1782481032.855222:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366210176 00000100:00100000:1.0:1782481032.855280:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:1.0:1782481032.855290:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+7:14379:x1869066366210176:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:1.0:1782481032.855310:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481032.855331:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093200/0x4776e02a9acf65da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a012a expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782481032.855464:0:14206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782481032.855584:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093200/0x4776e02a9acf65da lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a012a expref: 9 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.855599:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:1.0:1782481032.855614:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1782481032.855620:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093200/0x4776e02a9acf65da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a012a expref: 9 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481032.855635:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c2093200, rc 0) 00000100:00100000:1.0:1782481032.856707:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+8:14379:x1869066366210176:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1411us (1557us total) trans 8589934595 rc 301/301 00000100:00100000:1.0:1782481032.856717:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 23 00000100:00100000:3.0:1782481032.859849:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481032.860048:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366210432 00000100:00100000:0.0:1782481032.860069:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366210432 00000100:00100000:0.0:1782481032.860133:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:0.0:1782481032.860143:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+8:14379:x1869066366210432:12345-192.168.201.58@tcp:36:lfs.0 00010000:00010000:0.0:1782481032.860210:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782481032.860245:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7fee2ca00/0x4776e02a9acf65d3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0123 expref: 8 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.860267:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:0.0:1782481032.860281:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1782481032.860312:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.860329:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.860340:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1782481032.860927:0:14207:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000bd4c595c reply state 00000000e187b1e7 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481032.860938:0:14207:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:0.0:1782481032.860954:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:0.0:1782481032.861035:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+9:14379:x1869066366210432:12345-192.168.201.58@tcp:36:lfs.0 Request processed in 892us (1197us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1782481032.861043:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 24 00000100:00100000:0.0:1782481032.874491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00010000:00010000:0.0:1782481032.874557:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.874571:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.874579:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.874587:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481032.874592:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.874602:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.874619:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91d7c32f3900) 00010000:00010000:0.0:1782481032.874622:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:0.0:1782481032.874628:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.874635:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf65e8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481032.874718:0:14209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366210688 00000100:00100000:0.0:1782481032.874731:0:14209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366210688 00000100:00100000:0.0:1782481032.874778:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1782481032.874789:0:14209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+8:14379:x1869066366210688:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1782481032.875064:0:14209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+9:14379:x1869066366210688:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 275us (587us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1782481032.875090:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1782481032.878728:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481032.878841:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366210944 00000100:00100000:0.0:1782481032.878853:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366210944 00000100:00100000:0.0:1782481032.878973:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:0.0:1782481032.878986:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+9:14379:x1869066366210944:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:0.0:1782481032.879012:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481032.879033:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf65ef lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0131 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.879209:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf65f6 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.879225:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf65f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.879237:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf65f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.879252:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf65fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.879260:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf65fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.879267:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf65fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782481032.879410:0:14206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:1.0:1782481032.880027:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1782481032.880730:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf65f6 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880758:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf65f6 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880765:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf65f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880771:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297bc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481032.880775:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf65f6 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880783:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf65f6 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880801:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:0.0:1782481032.880805:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481032.880810:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf65f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880816:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf65f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880835:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf65fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880841:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf65fd lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880845:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf65fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880850:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481032.880859:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf65fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880866:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf65fd lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880873:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91d7c32f3c00) 00010000:00010000:0.0:1782481032.880876:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481032.880879:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf65fd lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.880884:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf65fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.881513:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf65ef lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0131 expref: 11 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.881768:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:0.0:1782481032.881771:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782481032.881776:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf65ef lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0131 expref: 11 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.881788:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a800, rc 0) 00000100:00100000:0.0:1782481032.881939:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+10:14379:x1869066366210944:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 2954us (3220us total) trans 8589934598 rc 301/301 00000100:00100000:0.0:1782481032.881949:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 25 00000100:00100000:3.0:1782481032.888325:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481032.888386:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366211072 00000100:00100000:2.0:1782481032.888397:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366211072 00000100:00100000:2.0:1782481032.888457:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:2.0:1782481032.888467:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+10:14379:x1869066366211072:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1782481032.888492:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481032.888523:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030600/0x4776e02a9acf660b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0138 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.888634:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.888648:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.888688:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481032.888743:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1782481032.888746:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782481032.888772:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.888800:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030600/0x4776e02a9acf660b lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0138 expref: 12 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.888817:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0138 expref: 11 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.888825:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91d7c610b000) 00010000:00010000:2.0:1782481032.888828:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1782481032.888838:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0031e00, rc 0) 00000100:00100000:2.0:1782481032.889305:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+11:14379:x1869066366211072:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 837us (989us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481032.889312:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 26 00000100:00100000:1.0:1782481032.895397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481032.895481:0:14209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366211200 00000100:00100000:0.0:1782481032.895492:0:14209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366211200 00000100:00100000:0.0:1782481032.895564:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:0.0:1782481032.895575:0:14209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+11:14379:x1869066366211200:12345-192.168.201.58@tcp:37:lfs.0 00000100:00100000:0.0:1782481032.899345:0:14209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+11:14379:x1869066366211200:12345-192.168.201.58@tcp:37:lfs.0 Request processed in 3760us (3946us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481032.899359:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:1.0:1782481032.904392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481032.904753:0:14210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366211456 00000100:00100000:3.0:1782481032.904765:0:14210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366211456 00000100:00100000:3.0:1782481032.904833:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:3.0:1782481032.904843:0:14210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df41a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+11:14379:x1869066366211456:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:3.0:1782481032.906070:0:14210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df41a050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+12:14379:x1869066366211456:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 1220us (1680us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1782481032.906082:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:3.0:1782481032.980564:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481032.980713:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366211584 00000100:00100000:0.0:1782481032.980724:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366211584 00000100:00100000:0.0:1782481032.980792:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:0.0:1782481032.980803:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+10:14385:x1869066366211584:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:0.0:1782481032.980824:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481032.980849:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6619 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a013f expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.980917:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf6620 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.980932:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf6620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.980943:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf6620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.980956:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf6627 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.980963:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf6627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.980969:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf6627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981100:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf662e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981123:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf662e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981131:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf662e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782481032.981171:0:14206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:0.0:1782481032.981175:0:14206:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1782481032.981219:0:14206:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf662e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981231:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf6620 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981238:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf6620 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981244:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf6620 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981250:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481032.981254:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf6620 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981262:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf6620 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981274:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:0.0:1782481032.981277:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481032.981282:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf6620 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981297:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf6620 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981316:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf6627 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981321:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf6627 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981326:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf6627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981331:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297bc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481032.981334:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf6627 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981339:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf6627 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981347:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff91d7c32f3c00) 00010000:00010000:0.0:1782481032.981349:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481032.981352:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf6627 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981357:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf6627 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981391:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6619 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a013f expref: 12 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981414:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a600/0x4776e02a9acf662e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a013f expref: 11 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481032.981421:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91d7c610b000) 00010000:00010000:0.0:1782481032.981423:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1782481032.981426:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a600, rc 0) 00000100:00100000:0.0:1782481032.981502:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+11:14385:x1869066366211584:12345-192.168.201.58@tcp:101:bash.0 Request processed in 700us (949us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481032.981510:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 27 00000100:00100000:1.0:1782481032.991814:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481032.991936:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366211840 00000100:00100000:2.0:1782481032.991948:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366211840 00000100:00100000:2.0:1782481032.992045:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 28 00000100:00100000:2.0:1782481032.992110:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+11:14385:x1869066366211840:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1782481032.992133:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481032.992153:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6635 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0146 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.992295:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.992311:0:14207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0138 expref: 11 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.992321:0:14207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.992359:0:14207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0138 expref: 11 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.992372:0:14207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0138 expref: 11 pid: 14207 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481032.992385:0:14207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14207:1869066388223872:192.168.201.58@tcp:104: 00000100:00100000:2.0:1782481032.992553:0:14207:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c622ee40 going to sleep for 11 seconds 00000100:00100000:2.0:1782481032.996907:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481032.997078:0:14207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fea00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14207:1869066388223872:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782481032.997111:0:14207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481032.997230:0:14192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366211968 00000100:00100000:3.0:1782481032.997239:0:14192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366211968 00010000:00010000:3.0:1782481032.997288:0:14192:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0138 expref: 12 pid: 14207 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481032.997332:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1782481032.997344:0:14192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+12:2350:x1869066366211968:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1782481032.997363:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1782481032.997371:0:14192:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0138 expref: 12 pid: 14207 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.997402:0:14192:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0138 expref: 12 pid: 14207 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.997506:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031e00/0x4776e02a9acf6612 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0138 expref: 12 pid: 14207 timeout: 663 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.997595:0:14192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91d7c610b000) 00010000:00010000:3.0:1782481032.997601:0:14192:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.997611:0:14192:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.997618:0:14192:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481032.997650:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782481032.997765:0:14207:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.997772:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.997801:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.997810:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481032.997818:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481032.998091:0:14192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+11:2350:x1869066366211968:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 746us (1193us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481032.998100:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00010000:00010000:2.0:1782481033.000834:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.000856:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.000868:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481033.000881:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782481033.000910:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.000918:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.002129:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.002151:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0031a00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782481033.002157:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.002166:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.002182:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91d7c610b000) 00010000:00010000:2.0:1782481033.002185:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481033.002190:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.002197:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf663c lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1782481033.002215:0:14207:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 0000000067f11d16 reply state 00000000ccc323db transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481033.002223:0:14207:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1782481033.002273:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6635 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0146 expref: 14 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.002288:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0146 expref: 13 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.002295:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:2.0:1782481033.002297:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:2.0:1782481033.002299:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0030400, rc 0) 00000100:00100000:2.0:1782481033.002443:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:14385:x1869066366211840:12345-192.168.201.58@tcp:101:bash.0 Request processed in 10388us (10638us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1782481033.002458:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 28 00010000:00010000:3.0:1782481033.006360:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481033.006381:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481033.006390:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481033.006418:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0030200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782481033.006424:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481033.006432:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481033.006449:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff91d7c610be00) 00010000:00010000:3.0:1782481033.006452:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782481033.006458:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481033.006464:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6643 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481033.022179:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481033.022716:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366212096 00000100:00100000:2.0:1782481033.022727:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366212096 00000100:00100000:2.0:1782481033.022803:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:2.0:1782481033.022814:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+13:14385:x1869066366212096:12345-192.168.201.58@tcp:101:bash.0 00010000:00010000:2.0:1782481033.022839:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481033.022859:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6658 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a014d expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.022930:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.022946:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.022957:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481033.023008:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1782481033.023013:0:14208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1782481033.023034:0:14208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.023046:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.023075:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6658 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a014d expref: 15 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.023097:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a014d expref: 14 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.023125:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:2.0:1782481033.023128:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782481033.023132:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0031a00, rc 0) 00000100:00080000:3.0:1782481033.023378:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1782481033.023457:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:14385:x1869066366212096:12345-192.168.201.58@tcp:101:bash.0 Request processed in 644us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481033.023466:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 29 00000100:00100000:2.0:1782481033.030821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481033.030890:0:14209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366212352 00000100:00100000:0.0:1782481033.030900:0:14209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366212352 00000100:00100000:0.0:1782481033.030972:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:0.0:1782481033.030984:0:14209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:14385:x1869066366212352:12345-192.168.201.58@tcp:35:bash.0 00000100:00100000:0.0:1782481033.031366:0:14209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+15:14385:x1869066366212352:12345-192.168.201.58@tcp:35:bash.0 Request processed in 383us (551us total) trans 8589934601 rc 0/0 00000100:00100000:0.0:1782481033.031374:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:1.0:1782481033.144929:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481033.145036:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366212608 00000100:00100000:2.0:1782481033.145047:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366212608 00000100:00100000:2.0:1782481033.145116:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:2.0:1782481033.145127:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+15:14395:x1869066366212608:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1782481033.145163:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481033.145184:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6666 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0154 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481033.145321:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1782481033.145461:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6666 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0154 expref: 17 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.145475:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff91d7c610b200) 00010000:00010000:2.0:1782481033.145478:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1782481033.145483:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6666 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0154 expref: 17 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.145498:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0031200, rc 0) 00000100:00100000:2.0:1782481033.145577:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+16:14395:x1869066366212608:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 452us (659us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1782481033.145598:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:1.0:1782481033.150481:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481033.150593:0:14209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366212864 00000100:00100000:0.0:1782481033.150603:0:14209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366212864 00000100:00100000:0.0:1782481033.150704:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:0.0:1782481033.150716:0:14209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+16:14395:x1869066366212864:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1782481033.151208:0:14209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+17:14395:x1869066366212864:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 493us (737us total) trans 8589934603 rc 0/0 00000100:00100000:0.0:1782481033.151229:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1782481033.253942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481033.254623:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366213120 00000100:00100000:2.0:1782481033.254636:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366213120 00000100:00100000:2.0:1782481033.255332:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:2.0:1782481033.255347:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+17:14399:x1869066366213120:12345-192.168.201.58@tcp:101:lfs.0 00010000:00010000:2.0:1782481033.255370:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481033.255390:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6674 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a015b expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.255502:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf667b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.255529:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf667b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.255540:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf667b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481033.255552:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782481033.255715:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6674 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a015b expref: 20 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.256001:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf667b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a015b expref: 19 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.256012:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:2.0:1782481033.256015:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782481033.256019:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0030800, rc 0) 00000100:00100000:2.0:1782481033.256652:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+19:14399:x1869066366213120:12345-192.168.201.58@tcp:101:lfs.0 Request processed in 1305us (2718us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1782481033.256715:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:1.0:1782481033.263964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481033.264029:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481033.264127:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366213248 00000100:00100000:0.0:1782481033.264138:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366213248 00000100:00100000:0.0:1782481033.264208:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:0.0:1782481033.264220:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+19:14399:x1869066366213248:12345-192.168.201.58@tcp:54:lfs.0 00010000:00010000:0.0:1782481033.264292:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6689 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.264309:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6689 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.264322:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6689 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.264351:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6689 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.264358:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6689 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.264365:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6689 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.264371:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481033.264375:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6689 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.264382:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6689 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.264394:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:0.0:1782481033.264407:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782481033.264413:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6689 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.264430:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf6689 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481033.264509:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+19:14399:x1869066366213248:12345-192.168.201.58@tcp:54:lfs.0 Request processed in 292us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481033.264530:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 32 00000100:00100000:1.0:1782481033.267118:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481033.267233:0:14210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366213632 00000100:00100000:0.0:1782481033.267243:0:14210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366213632 00000100:00100000:0.0:1782481033.267301:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:0.0:1782481033.267311:0:14210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+19:14399:x1869066366213632:12345-192.168.201.58@tcp:35:lfs.0 00000100:00100000:0.0:1782481033.267569:0:14210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+20:14399:x1869066366213632:12345-192.168.201.58@tcp:35:lfs.0 Request processed in 259us (460us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1782481033.267577:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:2.0:1782481033.275449:0:14194:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366213376 00000100:00100000:2.0:1782481033.275472:0:14194:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366213376 00000100:00100000:2.0:1782481033.275574:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:2.0:1782481033.275586:0:14194:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+20:2352:x1869066366213376:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481033.275604:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481033.275636:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf667b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a015b expref: 20 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.275657:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:2.0:1782481033.275696:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481033.275773:0:14194:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+19:2352:x1869066366213376:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 189us (11743us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481033.275781:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000040:00080000:0.0:1782481033.377804:0:14240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1782481033.596354:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481033.596517:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366213888 00000100:00100000:2.0:1782481033.596532:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366213888 00000100:00100000:2.0:1782481033.596637:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:2.0:1782481033.596649:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+19:14430:x1869066366213888:12345-192.168.201.58@tcp:101:cat.0 00010000:00010000:2.0:1782481033.596736:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481033.596766:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf6690 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0162 expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.596934:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6697 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.596976:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6697 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.596992:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6697 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1782481033.597008:0:14208:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1782481033.597214:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf6690 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0162 expref: 22 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.597238:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6697 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0162 expref: 21 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.597250:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:2.0:1782481033.597253:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782481033.597259:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0031200, rc 0) 00000100:00100000:2.0:1782481033.597350:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+21:14430:x1869066366213888:12345-192.168.201.58@tcp:101:cat.0 Request processed in 703us (1018us total) trans 8589934606 rc 0/0 00000100:00100000:2.0:1782481033.597358:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 33 00000100:00100000:3.0:1782481033.604918:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481033.604984:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481033.605157:0:14210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366214272 00000100:00100000:2.0:1782481033.605173:0:14210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366214272 00000100:00100000:2.0:1782481033.605268:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:2.0:1782481033.605283:0:14210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+21:14430:x1869066366214272:12345-192.168.201.58@tcp:35:cat.0 00000100:00100000:2.0:1782481033.605856:0:14210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+22:14430:x1869066366214272:12345-192.168.201.58@tcp:35:cat.0 Request processed in 573us (867us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1782481033.605867:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 8 00000100:00100000:0.0:1782481033.606025:0:14192:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366214016 00000100:00100000:0.0:1782481033.606033:0:14192:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366214016 00000100:00100000:0.0:1782481033.606094:0:14192:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1782481033.606103:0:14192:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+22:2352:x1869066366214016:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1782481033.606118:0:14192:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1782481033.606154:0:14192:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf6697 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0162 expref: 22 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.606180:0:14192:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:0.0:1782481033.606187:0:14192:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1782481033.606234:0:14192:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+21:2352:x1869066366214016:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 133us (1340us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481033.606242:0:14192:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:2.0:1782481033.631162:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388224000:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1782481033.631308:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481033.631559:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388224000 00000100:00100000:0.0:1782481033.631570:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388224000 00000100:00100000:0.0:1782481033.631703:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782481033.631715:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388224000:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1782481033.631765:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1782481033.631839:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30ffb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388224000:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481033.631847:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1782481033.631907:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388224000:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1782481033.632361:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782481033.678254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481033.678383:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366214528 00000100:00100000:0.0:1782481033.678397:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366214528 00000100:00100000:0.0:1782481033.678482:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 34 00000100:00100000:0.0:1782481033.678494:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+21:14436:x1869066366214528:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:0.0:1782481033.678544:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481033.678585:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf66a5 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0169 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.678801:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.678821:0:14207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0146 expref: 22 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.678833:0:14207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a014d expref: 22 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.678868:0:14207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.678931:0:14207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a014d expref: 22 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.678949:0:14207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a014d expref: 22 pid: 14208 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481033.678967:0:14207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14207:1869066388224128:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782481033.679120:0:14207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0146 expref: 22 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.679130:0:14207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0146 expref: 22 pid: 14207 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481033.679139:0:14207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14207:1869066388224256:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782481033.679166:0:14207:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea0726c0 going to sleep for 11 seconds 00000100:00100000:0.0:1782481033.684194:0:14207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14207:1869066388224128:192.168.201.58@tcp:104: 00000100:00100000:0.0:1782481033.684213:0:14207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b5180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14207:1869066388224256:192.168.201.58@tcp:104: 00010000:00010000:0.0:1782481033.684248:0:14207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481033.688100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481033.688834:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481033.696848:0:14194:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366214656 00000100:00100000:2.0:1782481033.696873:0:14194:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366214656 00010000:00010000:2.0:1782481033.696953:0:14194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a014d expref: 23 pid: 14208 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481033.697019:0:14194:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366214784 00000100:00100000:2.0:1782481033.697022:0:14194:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366214784 00010000:00010000:2.0:1782481033.697036:0:14194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0146 expref: 24 pid: 14207 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481033.697070:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782481033.697081:0:14194:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fef1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+24:2350:x1869066366214656:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481033.697102:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481033.697109:0:14194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a014d expref: 24 pid: 14208 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.697134:0:14194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a014d expref: 24 pid: 14208 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.697164:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf665f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a014d expref: 24 pid: 14208 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.697187:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:2.0:1782481033.697194:0:14194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.697206:0:14194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.697237:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481033.697329:0:14194:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fef1d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+23:2350:x1869066366214656:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 249us (9244us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481033.697338:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:2.0:1782481033.697470:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:2.0:1782481033.697478:0:14194:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+22:2350:x1869066366214784:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481033.697487:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481033.697492:0:14194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0146 expref: 22 pid: 14207 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.697503:0:14194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0146 expref: 22 pid: 14207 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.697517:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf664a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0146 expref: 22 pid: 14207 timeout: 664 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.697527:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:2.0:1782481033.697531:0:14194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.697540:0:14194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.697549:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481033.700048:0:14207:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481033.700074:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782481033.700112:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1782481033.700428:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a800/0x4776e02a9acf66a5 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0169 expref: 23 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481033.700486:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b000/0x4776e02a9acf66ac lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0169 expref: 22 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481033.700497:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:1.0:1782481033.700500:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1782481033.700504:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b000, rc 0) 00000100:00100000:1.0:1782481033.700807:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+22:14436:x1869066366214528:12345-192.168.201.58@tcp:101:dd.0 Request processed in 22314us (22570us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1782481033.700820:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 34 00010000:00010000:2.0:1782481033.701277:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481033.701375:0:14194:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+21:2350:x1869066366214784:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 3894us (12542us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481033.701386:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 12 00000100:00100000:1.0:1782481033.707006:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481033.707228:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366215040 00000100:00100000:0.0:1782481033.707243:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366215040 00000100:00100000:0.0:1782481033.707345:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 35 00000100:00100000:0.0:1782481033.707358:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+21:14436:x1869066366215040:12345-192.168.201.58@tcp:36:dd.0 00010000:00010000:0.0:1782481033.707822:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.707845:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.707859:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1782481033.707922:0:14206:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:0.0:1782481033.707949:0:14206:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000a7830b8d reply state 000000009c41d834 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481033.707960:0:14206:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782481033.708081:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+24:14436:x1869066366215040:12345-192.168.201.58@tcp:36:dd.0 Request processed in 724us (1089us total) trans 8589934610 rc 0/0 00000100:00100000:0.0:1782481033.708091:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 35 00000020:00080000:0.0:1782481033.708097:0:14206:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1782481033.714935:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481033.715061:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366215168 00000100:00100000:2.0:1782481033.715075:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366215168 00000100:00100000:2.0:1782481033.715154:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 36 00000100:00100000:2.0:1782481033.715166:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+24:14436:x1869066366215168:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:2.0:1782481033.715202:0:14207:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481033.715231:0:14207:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf66c1 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0170 expref: -99 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.715318:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf66c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0170 expref: 25 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.715338:0:14207:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf66c1 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0170 expref: 25 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.715364:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:2.0:1782481033.715369:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782481033.715374:0:14207:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0030800, rc 0) 00000100:00100000:2.0:1782481033.715456:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+25:14436:x1869066366215168:12345-192.168.201.58@tcp:101:dd.0 Request processed in 293us (536us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481033.715464:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 36 00010000:00010000:0.0:1782481033.715648:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.715683:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.715692:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.715701:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297bc00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481033.715706:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.715737:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.715752:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:0.0:1782481033.715755:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481033.715760:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.715766:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66ba lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481033.749656:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481033.749853:0:14193:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366215424 00000100:00100000:2.0:1782481033.749868:0:14193:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366215424 00000100:00100000:2.0:1782481033.749955:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1782481033.749966:0:14193:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+24:14436:x1869066366215424:12345-192.168.201.58@tcp:103:dd.0 00010000:00010000:2.0:1782481033.750010:0:14193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481033.750041:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf66c1 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0170 expref: 24 pid: 14207 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.750066:0:14193:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:2.0:1782481033.750072:0:14193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481033.750138:0:14193:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+23:14436:x1869066366215424:12345-192.168.201.58@tcp:103:dd.0 Request processed in 174us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481033.750147:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:3.0:1782481033.753272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481033.753352:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366215552 00000100:00100000:2.0:1782481033.753369:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366215552 00000100:00100000:2.0:1782481033.753454:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:2.0:1782481033.753464:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+23:14436:x1869066366215552:12345-192.168.201.58@tcp:58:dd.0 00010000:00010000:2.0:1782481033.753633:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.753711:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481033.753727:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1782481033.758501:0:14208:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1782481033.758737:0:14208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:2.0:1782481033.758813:0:14208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:2.0:1782481033.758992:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+23:14436:x1869066366215552:12345-192.168.201.58@tcp:58:dd.0 Request processed in 5519us (5736us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481033.759005:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 37 00000100:00100000:1.0:1782481033.766837:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481033.767227:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366215680 00000100:00100000:0.0:1782481033.767248:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366215680 00000100:00100000:0.0:1782481033.767367:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 38 00000100:00100000:0.0:1782481033.767380:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+23:14436:x1869066366215680:12345-192.168.201.58@tcp:101:dd.0 00010000:00010000:0.0:1782481033.767415:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481033.767446:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0177 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.767559:0:14206:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.767585:0:14206:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66cf lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0177 expref: 24 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.767618:0:14206:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.767635:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66cf lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0177 expref: 24 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.767742:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:0.0:1782481033.767747:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1782481033.767752:0:14206:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66cf lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0177 expref: 24 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481033.767761:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297bc00, rc 0) 00000100:00100000:0.0:1782481033.767875:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+24:14436:x1869066366215680:12345-192.168.201.58@tcp:101:dd.0 Request processed in 497us (1050us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481033.767884:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 38 00010000:00010000:1.0:1782481033.888594:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1782481034.266784:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934610 is committed 00000001:00080000:1.0:1782481034.266815:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934598 is committed 00000001:00080000:1.0:1782481034.266848:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000040:00080000:0.0:1782481034.399072:0:14240:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:0.0:1782481034.399087:0:14240:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1782481034.399248:0:14240:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:0.0:1782481034.399256:0:14240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1782481034.399436:0:14240:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14240:1869066388224384:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1782481034.399758:0:14240:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072f00 going to sleep for 11 seconds 00000100:00100000:3.0:1782481034.405891:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481034.406468:0:14217:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366215808 00000100:00100000:1.0:1782481034.406488:0:14217:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366215808 00000100:00100000:1.0:1782481034.406579:0:14217:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:1.0:1782481034.406592:0:14217:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3057645e-c20b-49f1-9cb3-c94df18fd1de+12:14437:x1869066366215808:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1782481034.406783:0:14217:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:3057645e-c20b-49f1-9cb3-c94df18fd1de+12:14437:x1869066366215808:12345-192.168.201.58@tcp:900:lhsmtool_posix.0 Request processed in 193us (913us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481034.406792:0:14217:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:0.0:1782481034.407287:0:14240:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b5180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14240:1869066388224384:192.168.201.58@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1782481034.414409:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481034.414740:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366215936 00000100:00100000:2.0:1782481034.414754:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366215936 00000100:00100000:2.0:1782481034.414832:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:2.0:1782481034.414843:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+11:14437:x1869066366215936:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782481034.414908:0:14208:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782481034.415069:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+11:14437:x1869066366215936:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 227us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481034.415077:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 39 00000100:00100000:3.0:1782481034.423426:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481034.424302:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366216064 00000100:00100000:1.0:1782481034.424322:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366216064 00000100:00100000:1.0:1782481034.424427:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:1.0:1782481034.424440:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+11:14437:x1869066366216064:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1782481034.424545:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092c00/0x4776e02a9acf66d6 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.424567:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092c00/0x4776e02a9acf66d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.424582:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092c00/0x4776e02a9acf66d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.435878:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf66dd lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.435906:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf66dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.435920:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf66dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.435958:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.435967:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.435974:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1782481034.436029:0:14207:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1782481034.436047:0:14207:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1782481034.436068:0:14207:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436081:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092c00/0x4776e02a9acf66d6 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436088:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092c00/0x4776e02a9acf66d6 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436095:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092c00/0x4776e02a9acf66d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436102:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2092c00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782481034.436106:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092c00/0x4776e02a9acf66d6 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436114:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092c00/0x4776e02a9acf66d6 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436128:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c32f3200) 00010000:00010000:1.0:1782481034.436131:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481034.436135:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092c00/0x4776e02a9acf66d6 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436142:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092c00/0x4776e02a9acf66d6 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436157:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf66dd lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436163:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf66dd lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436180:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf66dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436185:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2093600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782481034.436188:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf66dd lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436195:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf66dd lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436201:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff91d7c51d1f00) 00010000:00010000:1.0:1782481034.436204:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481034.436206:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf66dd lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436212:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf66dd lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436230:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436237:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436242:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436246:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2092000 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:1.0:1782481034.436249:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436264:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436272:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:1.0:1782481034.436274:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1782481034.436277:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.436282:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092000/0x4776e02a9acf66e4 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481034.436398:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa78380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+11:14437:x1869066366216064:12345-192.168.201.58@tcp:34:lhsmtool_posix.0 Request processed in 11956us (12978us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481034.436410:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 40 00000100:00100000:3.0:1782481034.439620:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481034.439743:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366216320 00000100:00100000:0.0:1782481034.439762:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366216320 00000100:00100000:0.0:1782481034.439844:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:0.0:1782481034.439857:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+11:14437:x1869066366216320:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782481034.439886:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481034.439913:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf66eb lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a017e expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440050:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf66f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440088:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf66f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440103:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf66f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1782481034.440132:0:14206:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1782481034.440319:0:14206:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf66f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440327:0:14206:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf66f2 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440335:0:14206:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf66f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440341:0:14206:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481034.440347:0:14206:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf66f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440354:0:14206:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf66f2 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440368:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:0.0:1782481034.440372:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1782481034.440378:0:14206:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf66f2 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440385:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297a400/0x4776e02a9acf66f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440436:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf66eb lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a017e expref: 13 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440454:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff91d7c32f3200) 00010000:00010000:0.0:1782481034.440457:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1782481034.440463:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297b600/0x4776e02a9acf66eb lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a017e expref: 13 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.440480:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297b600, rc 0) 00000100:00100000:0.0:1782481034.440594:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+12:14437:x1869066366216320:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 739us (983us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1782481034.440603:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 41 00000100:00100000:3.0:1782481034.445005:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481034.445090:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366216448 00000100:00100000:2.0:1782481034.445101:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366216448 00000100:00100000:2.0:1782481034.445169:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:2.0:1782481034.445179:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+12:14437:x1869066366216448:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1782481034.445217:0:14207:0:(mdt_handler.c:7960:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1782481034.454849:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa7a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+12:14437:x1869066366216448:12345-192.168.201.58@tcp:53:lhsmtool_posix.0 Request processed in 9659us (9841us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481034.454863:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 42 00000100:00100000:3.0:1782481034.459191:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481034.459415:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366216704 00000100:00100000:1.0:1782481034.459426:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366216704 00000100:00100000:1.0:1782481034.459489:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:1.0:1782481034.459508:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+12:14437:x1869066366216704:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1782481034.459530:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1782481034.459551:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf6700 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0185 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1782481034.465267:0:14206:0:(osp_internal.h:570:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x6:0x0], count =28 00000004:00080000:2.0:1782481034.465286:0:14206:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x6:0x0]+28 in llog 00000004:00080000:2.0:1782481034.466152:0:14206:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:2.0:1782481034.467296:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf6707 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.467316:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf6707 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.467328:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf6707 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.468214:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2093600/0x4776e02a9acf6700 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0185 expref: 15 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.468241:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf6707 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0185 expref: 14 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.468251:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610be00) 00010000:00010000:2.0:1782481034.468254:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1782481034.468258:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0030800, rc 0) 00000100:00100000:2.0:1782481034.468332:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa79500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:14437:x1869066366216704:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 8833us (9150us total) trans 8589934612 rc 0/0 00000100:00100000:2.0:1782481034.468341:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 43 00000100:00100000:0.0:1782481034.481933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481034.482061:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366216960 00000100:00100000:2.0:1782481034.482075:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366216960 00000100:00100000:2.0:1782481034.482174:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:2.0:1782481034.482187:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:14437:x1869066366216960:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1782481034.482279:0:14207:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481034.482317:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030800/0x4776e02a9acf6707 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0185 expref: 14 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482343:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610be00) 00010000:00010000:2.0:1782481034.482356:0:14207:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1782481034.482385:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf6715 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482400:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf6715 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482430:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf6715 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482449:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf671c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x568f86 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482456:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf671c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x568f86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482464:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf671c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x568f86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482862:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf6715 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482873:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf6715 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482880:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf6715 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482887:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0031a00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782481034.482892:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf6715 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482901:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf6715 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482912:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff91d7c610b000) 00010000:00010000:2.0:1782481034.482914:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481034.482918:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf6715 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482930:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031a00/0x4776e02a9acf6715 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482943:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf671c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x568f86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482950:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf671c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x568f86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482956:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf671c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x568f86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482961:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0031200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:2.0:1782481034.482964:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf671c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x568f86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482972:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf671c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x568f86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482981:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x568f86 (ffff91d7c610b500) 00010000:00010000:2.0:1782481034.482984:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1782481034.482987:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf671c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x568f86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.482994:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0031200/0x4776e02a9acf671c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x568f86 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481034.483112:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+13:14437:x1869066366216960:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 925us (1192us total) trans 0 rc -2/-2 00000100:00100000:2.0:1782481034.483123:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 44 00000100:00100000:0.0:1782481034.485770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481034.486470:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366217088 00000100:00100000:2.0:1782481034.486486:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366217088 00000100:00100000:2.0:1782481034.486637:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:2.0:1782481034.486698:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+13:14437:x1869066366217088:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782481034.486729:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481034.486760:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6723 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a018c expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.486813:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030600/0x4776e02a9acf672a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.486831:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030600/0x4776e02a9acf672a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.486847:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030600/0x4776e02a9acf672a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.486988:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6723 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a018c expref: 15 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.487014:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030600/0x4776e02a9acf672a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a018c expref: 14 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.487025:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:2.0:1782481034.487028:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1782481034.487046:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0030600, rc 0) 00000100:00100000:2.0:1782481034.487144:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:14437:x1869066366217088:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 496us (1404us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481034.487153:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 45 00000100:00100000:3.0:1782481034.493545:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481034.496167:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366217344 00000100:00100000:0.0:1782481034.496193:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366217344 00000100:00100000:0.0:1782481034.496276:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 46 00000100:00100000:0.0:1782481034.496288:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d6c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:14437:x1869066366217344:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1782481034.496413:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.496435:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.496450:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1782481034.497187:0:14208:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:0.0:1782481034.497204:0:14208:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 565058544096ns, next at 566058541259ns, rc = 0 00000004:00010000:0.0:1782481034.497331:0:14208:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 000000007301f1f2 reply state 000000009f0571b7 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481034.497353:0:14208:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1782481034.497535:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d6c1e74700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+16:14437:x1869066366217344:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 1243us (3995us total) trans 8589934613 rc 0/0 00000100:00100000:0.0:1782481034.497546:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 46 00010000:00010000:3.0:1782481034.500724:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.500748:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.500757:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.500764:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297be00 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782481034.500771:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.500779:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.500803:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:3.0:1782481034.500807:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1782481034.500813:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.500819:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297be00/0x4776e02a9acf6731 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481034.513167:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481034.513442:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366217472 00000100:00100000:2.0:1782481034.513456:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366217472 00000100:00100000:2.0:1782481034.513541:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:2.0:1782481034.513554:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+15:14437:x1869066366217472:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1782481034.513587:0:14206:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1782481034.513615:0:14206:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6738 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a0193 expref: -99 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.513757:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6738 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0193 expref: 16 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.513776:0:14206:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6738 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0193 expref: 16 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.513803:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:2.0:1782481034.513807:0:14206:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1782481034.513812:0:14206:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c0030200, rc 0) 00000100:00100000:2.0:1782481034.513898:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+16:14437:x1869066366217472:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 347us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481034.513908:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 47 00000100:00100000:0.0:1782481034.535478:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481034.536263:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366217600 00000100:00100000:2.0:1782481034.536278:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366217600 00000100:00100000:2.0:1782481034.536371:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1782481034.536384:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2351:x1869066366217600:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1782481034.536930:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:2351:x1869066366217600:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 546us (1463us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1782481034.536939:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00080000:3.0:1782481034.537833:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1782481034.544027:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481034.544526:0:14210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366217856 00000100:00100000:2.0:1782481034.544540:0:14210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366217856 00000100:00100000:2.0:1782481034.544628:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:2.0:1782481034.544641:0:14210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+16:14437:x1869066366217856:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1782481034.548513:0:14210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+17:14437:x1869066366217856:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 3845us (4472us total) trans 8589934614 rc 0/0 00000100:00100000:3.0:1782481034.548536:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 9 00000100:00100000:1.0:1782481034.555996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481034.556408:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366218112 00000100:00100000:2.0:1782481034.556424:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366218112 00000100:00100000:2.0:1782481034.556511:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:2.0:1782481034.556524:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d8006bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+17:14437:x1869066366218112:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1782481034.556736:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d8006bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+17:14437:x1869066366218112:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 215us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481034.556745:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 48 00000100:00100000:0.0:1782481034.559950:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481034.560474:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366218240 00000100:00100000:3.0:1782481034.560531:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366218240 00000100:00100000:3.0:1782481034.560607:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:3.0:1782481034.560638:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+17:14437:x1869066366218240:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1782481034.560882:0:14208:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1782481034.560909:0:14208:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf673f lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a019a expref: -99 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.560999:0:14208:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6746 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.561017:0:14208:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6746 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.561405:0:14208:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6746 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1782481034.561457:0:14208:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1782481034.561483:0:14208:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6746 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.561586:0:14208:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf673f lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a019a expref: 19 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.561610:0:14208:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6746 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a019a expref: 18 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.561619:0:14208:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:3.0:1782481034.561622:0:14208:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1782481034.561626:0:14208:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d7c779a200, rc 0) 00000100:00100000:3.0:1782481034.562057:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+18:14437:x1869066366218240:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 1418us (2117us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481034.562086:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 49 00000100:00100000:1.0:1782481034.575544:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481034.575731:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366218368 00000100:00100000:0.0:1782481034.575747:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366218368 00000100:00100000:0.0:1782481034.575844:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:0.0:1782481034.575857:0:14845:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+6:2350:x1869066366218368:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1782481034.575888:0:14845:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1782481034.575923:0:14845:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000cafd904c/0x4776e02a9acf674d lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x905acca49d9a01a1 expref: -99 pid: 14845 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782481034.575979:0:14845:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a3e808a, blocks: 0x1 00010000:00010000:0.0:1782481034.576008:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=565s v=(0 0) 00010000:00010000:0.0:1782481034.576013:0:14845:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481034.576026:0:14845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000cafd904c/0x4776e02a9acf674d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a01a1 expref: 7 pid: 14845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.576069:0:14845:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000cafd904c/0x4776e02a9acf674d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a01a1 expref: 7 pid: 14845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.576088:0:14845:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff91d6c297a400, rc 0) 00000100:00100000:0.0:1782481034.576185:0:14845:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:2350:x1869066366218368:12345-192.168.201.58@tcp:101:lhsmtool_posix.0 Request processed in 330us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481034.576231:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1782481034.580018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481034.580267:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366218624 00000100:00100000:0.0:1782481034.580282:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366218624 00000100:00100000:0.0:1782481034.580424:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:0.0:1782481034.580438:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+18:14437:x1869066366218624:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1782481034.580598:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+18:14437:x1869066366218624:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 163us (594us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481034.580607:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 50 00000100:00100000:3.0:1782481034.585558:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481034.585949:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366218752 00000100:00100000:0.0:1782481034.585960:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366218752 00000100:00100000:0.0:1782481034.586033:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:0.0:1782481034.586060:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+18:14437:x1869066366218752:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1782481034.653626:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934613 is committed 00000004:00080000:3.0:1782481034.653707:0:5825:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000100:00100000:0.0:1782481034.653990:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7fe9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388224512:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1782481034.654081:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+16:14437:x1869066366218752:12345-192.168.201.58@tcp:44:lhsmtool_posix.0 Request processed in 68022us (68529us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481034.654094:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 51 00000100:00100000:0.0:1782481034.654205:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481034.654440:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388224512 00000100:00100000:2.0:1782481034.654450:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388224512 00000100:00100000:2.0:1782481034.654542:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1782481034.654553:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388224512:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1782481034.654791:0:14842:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782481034.654796:0:14842:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:2.0:1782481034.654798:0:14842:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1782481034.654801:0:14842:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782481034 -> 1782481034 00002000:00010000:2.0:1782481034.654803:0:14842:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782481034.654936:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3310:x1869066388224512:12345-0@lo:2:osp-syn-1-0.0 Request processed in 383us (732us total) trans 8589934595 rc 0/0 00000100:00100000:2.0:1782481034.654944:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000004:00080000:1.0:1782481034.655021:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff91d7fe9b6680/2, rc 0, transno 8589934595 00000100:00100000:1.0:1782481034.655034:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7fe9b6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388224512:0@lo:2:osp-syn-1-0.0 00000100:00080000:0.0:1782481034.655153:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:3.0:1782481034.655300:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000100:00100000:2.0:1782481034.655342:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388224768:0@lo:400:kworker.0 00000100:00100000:2.0:1782481034.655991:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481034.656164:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388225280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782481034.656201:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481034.656238:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1782481034.656245:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388224896:0@lo:400:kworker.0 00000100:00100000:2.0:1782481034.656269:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1782481034.656318:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388225280 00000100:00100000:1.0:1782481034.656330:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388225280 00000100:00100000:2.0:1782481034.656346:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388224896 00000100:00100000:2.0:1782481034.656355:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388224896 00000100:00100000:1.0:1782481034.656402:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1782481034.656418:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388225280:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782481034.656428:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782481034.656439:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7efe70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388224896:12345-0@lo:400:kworker.0 00002000:00000024:1.0:1782481034.656470:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1782481034.656495:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe70a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388224896:12345-0@lo:400:kworker.0 Request processed in 57us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481034.656505:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1782481034.656537:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3311:1869066388224640:0@lo:400:kworker.0 00000100:00100000:1.0:1782481034.656566:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7efe73800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1869066388225280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 151us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481034.656578:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1782481034.656585:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481034.656630:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388225152:0@lo:400:kworker.0 00000100:00100000:2.0:1782481034.656696:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481034.656724:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1782481034.656729:0:3311:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c30fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388225024:0@lo:400:kworker.0 00000100:00100000:2.0:1782481034.656749:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1782481034.656772:0:14201:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388224640 00000100:00100000:2.0:1782481034.656776:0:14201:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388224640 00000100:00100000:2.0:1782481034.656803:0:14201:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1782481034.656809:0:14201:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3311:x1869066388224640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481034.656917:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388225152 00000100:00100000:1.0:1782481034.656924:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388225152 00000100:00100000:1.0:1782481034.656967:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388225024 00000100:00100000:1.0:1782481034.656971:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388225024 00000100:00100000:1.0:1782481034.657014:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1782481034.657015:0:14201:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3311:x1869066388224640:12345-0@lo:400:kworker.0 Request processed in 198us (425us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481034.657026:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388225152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1782481034.657086:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1869066388225152:12345-0@lo:400:kworker.0 Request processed in 61us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481034.657094:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1782481034.657107:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782481034.657134:0:14201:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1782481034.657135:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388225024:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1782481034.658708:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1869066388225024:0@lo:400:kworker.0 00000100:00100000:2.0:1782481034.658779:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3311:1869066388224640:0@lo:400:kworker.0 00000100:00100000:1.0:1782481034.660802:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1869066388225024:12345-0@lo:400:kworker.0 Request processed in 76us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481034.660836:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1782481034.662064:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388224896:0@lo:400:kworker.0 00000100:00100000:2.0:1782481034.662094:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfa54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388225280:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1782481034.662148:0:3311:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1869066388225152:0@lo:400:kworker.0 00000100:00100000:0.0:1782481034.665827:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388224768 00000100:00100000:0.0:1782481034.665844:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388224768 00000100:00100000:0.0:1782481034.665928:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782481034.665939:0:14845:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c30fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388224768:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481034.666062:0:14845:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c30fea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388224768:12345-0@lo:400:kworker.0 Request processed in 124us (10075us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481034.666070:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1782481034.666103:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1782481034.666161:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c30fdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388224768:0@lo:400:kworker.0 00000100:00100000:0.0:1782481034.671782:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481034.672386:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366218880 00000100:00100000:1.0:1782481034.672406:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366218880 00000100:00100000:1.0:1782481034.672487:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1782481034.672501:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7fe9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:2350:x1869066366218880:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1782481034.672817:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7fe9b7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:2350:x1869066366218880:12345-192.168.201.58@tcp:16:lhsmtool_posix.0 Request processed in 317us (1048us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481034.672826:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:1.0:1782481034.681008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481034.681075:0:14206:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366219136 00000100:00100000:1.0:1782481034.681090:0:14206:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366219136 00000100:00100000:1.0:1782481034.681170:0:14206:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 52 00000100:00100000:1.0:1782481034.681182:0:14206:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:14437:x1869066366219136:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1782481034.681279:0:14206:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481034.681320:0:14206:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6746 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a019a expref: 14 pid: 14208 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.681348:0:14206:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:1.0:1782481034.681356:0:14206:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1782481034.681400:0:14206:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.681419:0:14206:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.681432:0:14206:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1782481034.681764:0:14206:0:(mdt_handler.c:4478:mdt_save_lock()) ### save lock request 00000000d22ef400 reply state 00000000f467342a transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481034.681777:0:14206:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1782481034.681925:0:14206:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+15:14437:x1869066366219136:12345-192.168.201.58@tcp:36:lhsmtool_posix.0 Request processed in 744us (937us total) trans 8589934615 rc 0/0 00000100:00100000:1.0:1782481034.681955:0:14206:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 52 00010000:00010000:0.0:1782481034.691256:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.691274:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.691282:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.691288:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2092200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:0.0:1782481034.691294:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.691302:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.691322:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:0.0:1782481034.691325:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1782481034.691329:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481034.691335:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c2092200/0x4776e02a9acf6754 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14206 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481034.692816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481034.708175:0:14845:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366219264 00000100:00100000:2.0:1782481034.708206:0:14845:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366219264 00000100:00100000:2.0:1782481034.708328:0:14845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:2.0:1782481034.708343:0:14845:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:2351:x1869066366219264:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1782481034.708737:0:14845:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:2.0:1782481034.708741:0:14845:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1782481033 00002000:00010000:2.0:1782481034.708744:0:14845:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1782481033 00002000:00010000:2.0:1782481034.708747:0:14845:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782481034 -> 1782481033 00002000:00010000:2.0:1782481034.708749:0:14845:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1782481034.711513:0:14845:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+8:2351:x1869066366219264:12345-192.168.201.58@tcp:2:lhsmtool_posix.0 Request processed in 3150us (18692us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1782481034.711536:0:14845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1782481034.730366:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481034.730498:0:14844:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366219392 00000100:00100000:1.0:1782481034.730508:0:14844:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366219392 00000100:00100000:1.0:1782481034.730571:0:14844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:1.0:1782481034.730583:0:14844:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+8:2351:x1869066366219392:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1782481034.730634:0:14844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e8893ef4/0x4776e02a9acf675b lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.730683:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481034.730688:0:14844:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481034.730694:0:14844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e8893ef4/0x4776e02a9acf675b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.730710:0:14844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e8893ef4/0x4776e02a9acf675b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.730743:0:14844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e8893ef4/0x4776e02a9acf675b lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.730753:0:14844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e8893ef4/0x4776e02a9acf675b lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.730762:0:14844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e8893ef4/0x4776e02a9acf675b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.730790:0:14844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2093200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481034.730795:0:14844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8893ef4/0x4776e02a9acf675b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.730806:0:14844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e8893ef4/0x4776e02a9acf675b lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.730823:0:14844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e8893ef4/0x4776e02a9acf675b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481034.730832:0:14844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e8893ef4/0x4776e02a9acf675b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481034.730909:0:14844:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+8:2351:x1869066366219392:12345-192.168.201.58@tcp:1:lhsmtool_posix.0 Request processed in 328us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481034.730916:0:14844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:0.0:1782481034.741917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481034.743224:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366219648 00000100:00100000:3.0:1782481034.743238:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366219648 00000100:00100000:3.0:1782481034.743304:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 53 00000100:00100000:3.0:1782481034.743316:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:14437:x1869066366219648:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1782481034.743421:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6762 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.743441:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6762 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.743453:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6762 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.744920:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.744944:0:14207:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6738 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0193 expref: 15 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.744954:0:14207:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.744993:0:14207:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6738 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0193 expref: 15 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.745016:0:14207:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6738 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0193 expref: 15 pid: 14206 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481034.745032:0:14207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14207:1869066388225408:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782481034.747345:0:14207:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7cd711840 going to sleep for 11 seconds 00000100:00100000:3.0:1782481034.751549:0:14207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14207:1869066388225408:192.168.201.58@tcp:104: 00010000:00010000:3.0:1782481034.751582:0:14207:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481034.754177:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481034.754309:0:14194:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366219776 00000100:00100000:2.0:1782481034.754324:0:14194:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366219776 00010000:00010000:2.0:1782481034.754368:0:14194:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6738 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0193 expref: 16 pid: 14206 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481034.754412:0:14194:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 13 00000100:00100000:2.0:1782481034.754431:0:14194:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+16:2350:x1869066366219776:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1782481034.754448:0:14194:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1782481034.754454:0:14194:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6738 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0193 expref: 16 pid: 14206 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.754468:0:14194:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6738 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0193 expref: 16 pid: 14206 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.754493:0:14194:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030200/0x4776e02a9acf6738 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0193 expref: 16 pid: 14206 timeout: 665 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.754512:0:14194:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:2.0:1782481034.754518:0:14194:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.754527:0:14194:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.754534:0:14194:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.754566:0:14194:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1782481034.754636:0:14194:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:3057645e-c20b-49f1-9cb3-c94df18fd1de+15:2350:x1869066366219776:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 205us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481034.754655:0:14194:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 13 00010000:00010000:3.0:1782481034.755700:0:14207:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.755713:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782481034.755895:0:14207:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:3.0:1782481034.757231:0:14207:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:3.0:1782481034.757322:0:14207:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:3.0:1782481034.757413:0:14207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14207:1869066388225536:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782481034.757521:0:14207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481034.757550:0:14207:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7c622ee40 going to sleep for 11 seconds 00000100:00100000:1.0:1782481034.757652:0:14211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388225536 00000100:00100000:1.0:1782481034.757685:0:14211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388225536 00000100:00100000:1.0:1782481034.757735:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1782481034.757745:0:14211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14207:x1869066388225536:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1782481034.757822:0:14211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14207:x1869066388225536:12345-0@lo:1000:mdt00_001.0 Request processed in 78us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481034.757829:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1782481034.759852:0:14207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14207:1869066388225536:0@lo:1000:mdt00_001.0 00000001:00080000:3.0:1782481034.761949:0:14207:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:3.0:1782481034.762049:0:14207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14207:1869066388225664:0@lo:1000:mdt00_001.0 00000100:00100000:3.0:1782481034.762742:0:14207:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481034.762785:0:14207:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7cd711840 going to sleep for 11 seconds 00000100:00100000:0.0:1782481034.762873:0:14211:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388225664 00000100:00100000:0.0:1782481034.762890:0:14211:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388225664 00000100:00100000:0.0:1782481034.762976:0:14211:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1782481034.762988:0:14211:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14207:x1869066388225664:12345-0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1782481034.763324:0:14211:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14207:x1869066388225664:12345-0@lo:1000:mdt00_001.0 Request processed in 337us (582us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1782481034.763346:0:14211:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1782481034.763718:0:14207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f1180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14207:1869066388225664:0@lo:1000:mdt00_001.0 00010000:00010000:3.0:1782481034.763775:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763785:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763792:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763797:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782481034.763801:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763809:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763823:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:3.0:1782481034.763827:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782481034.763830:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763836:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6769 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763880:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763887:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763892:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763910:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0030400 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782481034.763914:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763934:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763945:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:3.0:1782481034.763947:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1782481034.763955:0:14207:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66cf lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0177 expref: 18 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763967:0:14207:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66cf lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0177 expref: 18 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.763976:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0177 expref: 18 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.764012:0:14207:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff91d6c297bc00/0x4776e02a9acf66cf lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a0177 expref: 18 pid: 14206 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481034.764025:0:14207:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14207:1869066388225792:192.168.201.58@tcp:105: 00000100:00100000:3.0:1782481034.764117:0:14207:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7cd59a780 going to sleep for 11 seconds 00000100:00100000:0.0:1782481034.770142:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481034.770286:0:14209:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366219904 00000100:00100000:1.0:1782481034.770306:0:14209:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366219904 00000100:00100000:1.0:1782481034.770407:0:14209:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:1.0:1782481034.770424:0:14209:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7df418450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+19:14436:x1869066366219904:12345-192.168.201.58@tcp:49:dd.0 00000100:00100000:1.0:1782481034.770596:0:14209:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7df418450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+19:14436:x1869066366219904:12345-192.168.201.58@tcp:49:dd.0 Request processed in 178us (474us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481034.770604:0:14209:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 10 00000100:00100000:3.0:1782481034.770743:0:14207:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f0000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14207:1869066388225792:192.168.201.58@tcp:105: 00010000:00010000:3.0:1782481034.770771:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770796:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c0030400/0x4776e02a9acf66c8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14208 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770829:0:14207:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf6770 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770842:0:14207:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf6770 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770852:0:14207:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf6770 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770861:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf6770 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770867:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf6770 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770873:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf6770 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770878:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782481034.770881:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf6770 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770888:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf6770 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770898:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:3.0:1782481034.770901:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1782481034.770905:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf6770 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770917:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a800/0x4776e02a9acf6770 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770927:0:14207:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6762 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770933:0:14207:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6762 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770938:0:14207:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6762 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770944:0:14207:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1e8d4f0) 00010000:00010000:3.0:1782481034.770946:0:14207:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6762 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770952:0:14207:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6762 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770960:0:14207:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff91d7c610b400) 00010000:00010000:3.0:1782481034.770962:0:14207:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1782481034.770964:0:14207:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6762 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.770969:0:14207:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779b600/0x4776e02a9acf6762 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14207 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481034.771181:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+18:14437:x1869066366219648:12345-192.168.201.58@tcp:57:lhsmtool_posix.0 Request processed in 27866us (29273us total) trans 8589934620 rc 0/0 00000100:00100000:3.0:1782481034.771191:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 53 00000020:00080000:3.0:1782481034.771201:0:14207:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1782481034.771402:0:14240:0:(llog.c:800:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1782481034.771408:0:14240:0:(llog_cat.c:834:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1782481034.771457:0:14240:0:(llog.c:857:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:1.0:1782481034.771463:0:14240:0:(llog.c:857:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000001:00080000:2.0:1782481034.780403:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1782481034.780425:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934594 is committed 00000100:00100000:0.0:1782481034.785039:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481034.785150:0:14210:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366220160 00000100:00100000:3.0:1782481034.785166:0:14210:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366220160 00000100:00100000:3.0:1782481034.785243:0:14210:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 11 00000100:00100000:3.0:1782481034.785257:0:14210:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+18:14437:x1869066366220160:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1782481034.786353:0:14210:0:(mdd_object.c:4010:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1782481034.788201:0:14210:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:3.0:1782481034.788336:0:14210:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.788361:0:14210:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.788376:0:14210:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.789199:0:14210:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.789224:0:14210:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.789232:0:14210:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.789363:0:14210:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1782481034.789566:0:14210:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3ba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+20:14437:x1869066366220160:12345-192.168.201.58@tcp:35:lhsmtool_posix.0 Request processed in 4305us (4535us total) trans 8589934622 rc 0/0 00000100:00100000:3.0:1782481034.789579:0:14210:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 11 00000020:00080000:3.0:1782481034.789587:0:14210:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1782481034.797077:0:14195:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1782481034.797099:0:14195:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.797142:0:14195:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a200 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782481034.797148:0:14195:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.797163:0:14195:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.797191:0:14195:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff91d7c610b100) 00010000:00010000:2.0:1782481034.797195:0:14195:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1782481034.797202:0:14195:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481034.797209:0:14195:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff91d7c779a200/0x4776e02a9acf6777 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14210 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481034.797322:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481034.797348:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1782481034.797351:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1782481034.910933:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481035.022256:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481035.022371:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481035.031885:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481035.034652:0:14848:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366220288 00000100:00100000:2.0:1782481035.034689:0:14848:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366220288 00000100:00100000:3.0:1782481035.035268:0:14848:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366220416 00000100:00100000:3.0:1782481035.035284:0:14848:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366220416 00000100:00100000:3.0:1782481035.035327:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:3.0:1782481035.035339:0:14848:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+8:2353:x1869066366220288:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:3.0:1782481035.035393:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.035415:0:14848:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000cafd904c/0x4776e02a9acf674d lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.201.58@tcp remote: 0x905acca49d9a01a1 expref: 8 pid: 14845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.035425:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481035.035429:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481035.035433:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.035471:0:14848:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000cafd904c/0x4776e02a9acf674d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a01a1 expref: 8 pid: 14845 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.035486:0:14848:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000cafd904c/0x4776e02a9acf674d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a01a1 expref: 8 pid: 14845 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481035.037348:0:14848:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:14848:1869066388225920:192.168.201.58@tcp:104: 00000100:00100000:3.0:1782481035.037478:0:14848:0:(client.c:2701:ptlrpc_set_wait()) set ffff91d7ea072f00 going to sleep for 11 seconds 00000100:00100000:0.0:1782481035.049138:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481035.049186:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481035.049201:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481035.049216:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481035.049261:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481035.050417:0:14849:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:1.0:1782481035.050444:0:14849:0:(service.c:3520:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:2.0:1782481035.050904:0:14850:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1782481035.050929:0:14850:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366220544 00000100:00100000:2.0:1782481035.050943:0:14850:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366220544 00000100:00100000:2.0:1782481035.051015:0:14850:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1782481035.051021:0:14850:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366220672 00000100:00100000:2.0:1782481035.051024:0:14850:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366220672 00000100:00100000:2.0:1782481035.051038:0:14850:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1782481035.051042:0:14850:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366220800 00000100:00100000:2.0:1782481035.051045:0:14850:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366220800 00000100:00100000:2.0:1782481035.051057:0:14850:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1782481035.051062:0:14850:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366220928 00000100:00100000:2.0:1782481035.051065:0:14850:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366220928 00000100:00100000:2.0:1782481035.051078:0:14850:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1782481035.051082:0:14850:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366221056 00000100:00100000:2.0:1782481035.051085:0:14850:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366221056 00000100:00100000:2.0:1782481035.051121:0:14850:0:(service.c:3461:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1782481035.051127:0:14850:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366221184 00000100:00100000:2.0:1782481035.051130:0:14850:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366221184 00000100:00100000:1.0:1782481035.051727:0:14848:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f0000 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:14848:1869066388225920:192.168.201.58@tcp:104: 00010000:00010000:1.0:1782481035.051767:0:14848:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481035.054973:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:0.0:1782481035.054998:0:16345:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:2353:x1869066366220416:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:0.0:1782481035.055053:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.055078:0:16345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481035.055084:0:16345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481035.055090:0:16345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.055101:0:16345:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481035.060365:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:1.0:1782481035.060807:0:14193:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366221312 00000100:00100000:1.0:1782481035.060823:0:14193:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366221312 00010000:00010000:1.0:1782481035.060892:0:14193:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000cafd904c/0x4776e02a9acf674d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a01a1 expref: 15 pid: 14845 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481035.060950:0:14193:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 14 00000100:00100000:1.0:1782481035.060963:0:14193:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ece6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+15:2351:x1869066366221312:12345-192.168.201.58@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1782481035.060983:0:14193:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1782481035.061015:0:14193:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000cafd904c/0x4776e02a9acf674d lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a01a1 expref: 15 pid: 14845 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.061225:0:14193:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000cafd904c/0x4776e02a9acf674d lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a01a1 expref: 15 pid: 14845 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.061258:0:14193:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000cafd904c/0x4776e02a9acf674d lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.201.58@tcp remote: 0x905acca49d9a01a1 expref: 15 pid: 14845 timeout: 665 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.061281:0:14193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481035.061286:0:14193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481035.061295:0:14193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.061307:0:14193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.061317:0:14193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481035.061320:0:14193:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481035.061323:0:14193:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.061330:0:14193:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.061384:0:14193:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1782481035.061491:0:14193:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ece6aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+14:2351:x1869066366221312:12345-192.168.201.58@tcp:103:ldlm_bl.0 Request processed in 519us (1133us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481035.061510:0:14193:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 14 00010000:00010000:3.0:1782481035.061766:0:14848:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.061767:0:16345:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.061793:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.061793:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1782481035.266867:0:14848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 2097152 00002000:00010000:0.0:1782481035.266878:0:14848:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1782481033 -> 1782481035 00002000:00010000:0.0:1782481035.266881:0:14848:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1782481033 -> 1782481035 00002000:00010000:0.0:1782481035.266883:0:14848:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1782481035.266900:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.266914:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.266923:0:14848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.266931:0:14848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779b600 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481035.266938:0:14848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.266948:0:14848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.266970:0:14848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.267000:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000061d05dcb/0x4776e02a9acf677e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481035.267266:0:14848:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+18:2353:x1869066366220288:12345-192.168.201.58@tcp:4:dd.0 Request processed in 231921us (245019us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1782481035.267278:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 0 00000100:00100000:0.0:1782481035.267319:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:0.0:1782481035.267332:0:14848:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+17:2353:x1869066366220544:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:0.0:1782481035.267386:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069380f2b/0x4776e02a9acf678c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.267403:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481035.267407:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1782481035.267414:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000069380f2b/0x4776e02a9acf678c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.267426:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000069380f2b/0x4776e02a9acf678c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782481035.271472:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00000001:00080000:2.0:1782481035.271647:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1782481035.271672:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00002000:00010000:2.0:1782481035.354511:0:16345:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 2097152 -> 3145728 00002000:00010000:2.0:1782481035.354526:0:16345:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 4103 00010000:00010000:2.0:1782481035.354550:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.354566:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.354577:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.354585:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297b600 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782481035.354590:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.354599:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.354621:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.354628:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009bdb9dcd/0x4776e02a9acf6785 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481035.354774:0:16345:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3bb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3057645e-c20b-49f1-9cb3-c94df18fd1de+16:2353:x1869066366220416:12345-192.168.201.58@tcp:4:dd.0 Request processed in 299781us (332398us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1782481035.354786:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 1 00000100:00100000:2.0:1782481035.354820:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:2.0:1782481035.354833:0:16345:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3057645e-c20b-49f1-9cb3-c94df18fd1de+15:2353:x1869066366220672:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:2.0:1782481035.354868:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044bdd471/0x4776e02a9acf6793 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.354881:0:16345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481035.354886:0:16345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481035.354892:0:16345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044bdd471/0x4776e02a9acf6793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.354904:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044bdd471/0x4776e02a9acf6793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1782481035.355026:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934599 is committed 00000001:00080000:0.0:1782481035.418001:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1782481035.418240:0:14848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1782481035.418245:0:14848:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 4103 -> 6151 00010000:00010000:2.0:1782481035.418261:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000069380f2b/0x4776e02a9acf678c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.418276:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000069380f2b/0x4776e02a9acf678c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.418307:0:14848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000069380f2b/0x4776e02a9acf678c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.418315:0:14848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c297a800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:2.0:1782481035.418321:0:14848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000069380f2b/0x4776e02a9acf678c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.418332:0:14848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000069380f2b/0x4776e02a9acf678c lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.418419:0:14848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000069380f2b/0x4776e02a9acf678c lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.418429:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000069380f2b/0x4776e02a9acf678c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1782481035.418653:0:14848:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ef3b9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+13:2353:x1869066366220544:12345-192.168.201.58@tcp:4:dd.0 Request processed in 151320us (386781us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1782481035.418700:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 2 00000100:00100000:2.0:1782481035.418735:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:2.0:1782481035.418747:0:14848:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+12:2353:x1869066366220800:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:2.0:1782481035.418782:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086beafca/0x4776e02a9acf679a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.418795:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481035.418808:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1782481035.418815:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000086beafca/0x4776e02a9acf679a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1782481035.418829:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000086beafca/0x4776e02a9acf679a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782481035.480363:0:16345:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:3.0:1782481035.480397:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000044bdd471/0x4776e02a9acf6793 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.480411:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000044bdd471/0x4776e02a9acf6793 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.480420:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000044bdd471/0x4776e02a9acf6793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.480428:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0031e00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481035.480434:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000044bdd471/0x4776e02a9acf6793 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.480443:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000044bdd471/0x4776e02a9acf6793 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.480468:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000044bdd471/0x4776e02a9acf6793 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.480485:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044bdd471/0x4776e02a9acf6793 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481035.480607:0:16345:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3057645e-c20b-49f1-9cb3-c94df18fd1de+12:2353:x1869066366220672:12345-192.168.201.58@tcp:4:dd.0 Request processed in 125773us (431483us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1782481035.480617:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 3 00000100:00100000:3.0:1782481035.480716:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1782481035.480730:0:16345:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3057645e-c20b-49f1-9cb3-c94df18fd1de+11:2353:x1869066366220928:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:3.0:1782481035.480772:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029a8dee/0x4776e02a9acf67a1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.480786:0:16345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1782481035.480791:0:16345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481035.480797:0:16345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029a8dee/0x4776e02a9acf67a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.480808:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000029a8dee/0x4776e02a9acf67a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782481035.480948:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000001:00080000:3.0:1782481035.576123:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00002000:00010000:1.0:1782481035.576303:0:14848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 6291456 00002000:00010000:1.0:1782481035.576310:0:14848:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:1.0:1782481035.576329:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000086beafca/0x4776e02a9acf679a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.576345:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000086beafca/0x4776e02a9acf679a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.576367:0:14848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000086beafca/0x4776e02a9acf679a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.576382:0:14848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c0031a00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:1.0:1782481035.576389:0:14848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000086beafca/0x4776e02a9acf679a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.576400:0:14848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000086beafca/0x4776e02a9acf679a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.576428:0:14848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000086beafca/0x4776e02a9acf679a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.576436:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000086beafca/0x4776e02a9acf679a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1782481035.576750:0:14848:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+11:2353:x1869066366220800:12345-192.168.201.58@tcp:4:dd.0 Request processed in 157997us (527553us total) trans 8589934602 rc 0/0 00000100:00100000:1.0:1782481035.576771:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 4 00000100:00100000:1.0:1782481035.576812:0:14848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 6 00000100:00100000:1.0:1782481035.576823:0:14848:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+10:2352:x1869066366221056:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:1.0:1782481035.576858:0:14848:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d71979d/0x4776e02a9acf67a8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.576871:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481035.576876:0:14848:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1782481035.576882:0:14848:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004d71979d/0x4776e02a9acf67a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1782481035.576895:0:14848:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004d71979d/0x4776e02a9acf67a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1782481035.739264:0:16345:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 6291456 -> 7340032 00010000:00010000:3.0:1782481035.739303:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029a8dee/0x4776e02a9acf67a1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.739317:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000029a8dee/0x4776e02a9acf67a1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.739418:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000029a8dee/0x4776e02a9acf67a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.739426:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779a800 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:3.0:1782481035.739431:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000029a8dee/0x4776e02a9acf67a1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.739441:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000029a8dee/0x4776e02a9acf67a1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.739462:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000029a8dee/0x4776e02a9acf67a1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.739470:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000029a8dee/0x4776e02a9acf67a1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1782481035.739576:0:16345:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3057645e-c20b-49f1-9cb3-c94df18fd1de+12:2353:x1869066366220928:12345-192.168.201.58@tcp:4:dd.0 Request processed in 258845us (690367us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1782481035.739587:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 5 00000100:00100000:3.0:1782481035.739640:0:16345:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 7 00000100:00100000:3.0:1782481035.739653:0:16345:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3057645e-c20b-49f1-9cb3-c94df18fd1de+11:2353:x1869066366221184:12345-192.168.201.58@tcp:4:dd.0 00010000:00010000:3.0:1782481035.739744:0:16345:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071787ff7/0x4776e02a9acf67af lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.739759:0:16345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481035.739770:0:16345:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1782481035.739777:0:16345:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000071787ff7/0x4776e02a9acf67af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1782481035.739788:0:16345:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000071787ff7/0x4776e02a9acf67af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1782481035.740079:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00000001:00080000:3.0:1782481035.897016:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00002000:00010000:0.0:1782481035.897143:0:14848:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 7340032 -> 7654321 00002000:00010000:0.0:1782481035.897149:0:14848:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:0.0:1782481035.897168:0:14848:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004d71979d/0x4776e02a9acf67a8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.897204:0:14848:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004d71979d/0x4776e02a9acf67a8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.897214:0:14848:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004d71979d/0x4776e02a9acf67a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.897221:0:14848:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d6c2093000 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481035.897226:0:14848:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004d71979d/0x4776e02a9acf67a8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.897236:0:14848:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004d71979d/0x4776e02a9acf67a8 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.897258:0:14848:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004d71979d/0x4776e02a9acf67a8 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481035.897267:0:14848:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004d71979d/0x4776e02a9acf67a8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 14848 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481035.897565:0:14848:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+9:2352:x1869066366221056:12345-192.168.201.58@tcp:4:dd.0 Request processed in 320741us (848343us total) trans 8589934604 rc 0/0 00000100:00100000:0.0:1782481035.897578:0:14848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 6 00010000:00010000:2.0:1782481035.941090:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1782481036.006327:0:16345:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:0.0:1782481036.006354:0:16345:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000071787ff7/0x4776e02a9acf67af lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481036.006382:0:16345:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000071787ff7/0x4776e02a9acf67af lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481036.006391:0:16345:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000071787ff7/0x4776e02a9acf67af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481036.006398:0:16345:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff91d7c779bc00 already unused, calling callback (ffffffffc1486ce0) 00010000:00010000:0.0:1782481036.006403:0:16345:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000071787ff7/0x4776e02a9acf67af lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481036.006413:0:16345:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000071787ff7/0x4776e02a9acf67af lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481036.006434:0:16345:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000071787ff7/0x4776e02a9acf67af lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1782481036.006442:0:16345:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000071787ff7/0x4776e02a9acf67af lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16345 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1782481036.006571:0:16345:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:3057645e-c20b-49f1-9cb3-c94df18fd1de+7:2353:x1869066366221184:12345-192.168.201.58@tcp:4:dd.0 Request processed in 266916us (957302us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1782481036.006581:0:16345:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 7 00000001:00080000:2.0:1782481036.011163:0:7517:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00000100:00100000:0.0:1782481036.783431:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481036.783487:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:0.0:1782481036.783531:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:2.0:1782481036.783824:0:16147:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366221696 00000100:00100000:2.0:1782481036.783835:0:16147:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366221696 00000100:00100000:2.0:1782481036.783913:0:16147:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00100000:2.0:1782481036.783925:0:16147:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2352:x1869066366221696:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782481036.784001:0:16147:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2352:x1869066366221696:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 79us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481036.784021:0:16147:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 16 00000100:00080000:0.0:1782481036.784168:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1782481036.786363:0:14208:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366221952 00000100:00100000:3.0:1782481036.786384:0:14208:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366221952 00000100:00100000:3.0:1782481036.786492:0:14208:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00100000:3.0:1782481036.786504:0:14208:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:2352:x1869066366221952:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782481036.786616:0:14208:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+6:2352:x1869066366221952:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 104us (3073us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481036.786624:0:14208:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 30 00000100:00080000:0.0:1782481036.786884:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1782481036.787996:0:14200:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366221440 00000100:00100000:1.0:1782481036.788009:0:14200:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366221440 00000100:00100000:1.0:1782481036.788075:0:14200:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:1.0:1782481036.788085:0:14200:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:2352:x1869066366221440:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:1.0:1782481036.788161:0:14200:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:75c6703e-3e35-47d3-ae4e-07cd32be5e35+13:2352:x1869066366221440:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 76us (4741us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481036.788168:0:14200:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 125 00000100:00100000:3.0:1782481036.789497:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481036.789715:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481036.789738:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481036.789768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.201.58@tcp (source: 12345-192.168.201.58@tcp) 00000100:00100000:3.0:1782481036.789802:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366222208 00000100:00100000:3.0:1782481036.789812:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366222208 00000100:00100000:3.0:1782481036.789873:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366221824 00000100:00100000:3.0:1782481036.789876:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366221824 00000100:00100000:3.0:1782481036.789891:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366222080 00000100:00100000:3.0:1782481036.789893:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366222080 00000100:00100000:3.0:1782481036.789912:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1782481036.789923:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2352:x1869066366222208:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782481036.790009:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2352:x1869066366222208:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 89us (520us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481036.790017:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 17 00000100:00100000:3.0:1782481036.790036:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:3.0:1782481036.790043:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2352:x1869066366221824:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782481036.790092:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:3057645e-c20b-49f1-9cb3-c94df18fd1de+5:2352:x1869066366221824:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 49us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481036.790100:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 18 00000100:00100000:3.0:1782481036.790114:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00100000:3.0:1782481036.790121:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2352:x1869066366222080:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:3.0:1782481036.790144:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:b1c38af0-aec8-4f5a-b9a2-2cc36817ec45+5:2352:x1869066366222080:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 25us (375us total) trans 0 rc 0/0 00000100:00100000:3.0:1782481036.790151:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 19 00000100:00080000:0.0:1782481036.790803:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1782481036.790810:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1782481036.790901:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066366221568 00000100:00100000:2.0:1782481036.790911:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066366221568 00000100:00100000:2.0:1782481036.790974:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00100000:2.0:1782481036.790982:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+20:2352:x1869066366221568:12345-192.168.201.58@tcp:400:kworker.0 00000100:00100000:2.0:1782481036.791042:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:3057645e-c20b-49f1-9cb3-c94df18fd1de+20:2352:x1869066366221568:12345-192.168.201.58@tcp:400:kworker.0 Request processed in 62us (1328us total) trans 0 rc 0/0 00000100:00100000:2.0:1782481036.791048:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.201.58@tcp, seq: 31 00000100:00080000:0.0:1782481036.791248:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1782481036.958943:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1782481037.978485:0:16382:0:(debug.c:654:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00010000:00010000:1.0:1782481037.994767:0:15804:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1782481038.751063:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1782481038.751098:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388226048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1782481038.751207:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481038.751730:0:14847:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388226048 00000100:00100000:3.0:1782481038.751741:0:14847:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388226048 00000100:00100000:1.0:1782481038.751927:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782481038.751941:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7dfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388226048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1782481038.751990:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1782481038.752055:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7dfa57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388226048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 118us (848us total) trans 0 rc 0/0 00000100:00100000:1.0:1782481038.752063:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1782481038.752121:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388226048:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1782481038.753699:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1782481039.016117:0:14196:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1782481039.781862:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388226176:0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.781963:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481039.782028:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388226688:0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.782060:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481039.782098:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1782481039.782104:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388226304:0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.782132:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481039.782149:0:3310:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388226816:0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.782168:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481039.782199:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388226432:0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.782224:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481039.782244:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1782481039.782250:0:3312:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7c67f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388226560:0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.782270:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1782481039.783333:0:14202:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388226176 00000100:00100000:0.0:1782481039.783346:0:14202:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388226176 00000100:00100000:0.0:1782481039.783635:0:14202:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782481039.783649:0:14202:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7ffc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3310:x1869066388226176:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.783801:0:14202:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7ffc0cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc+19:3310:x1869066388226176:12345-0@lo:400:kworker.0 Request processed in 154us (1838us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481039.783811:0:14202:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:0.0:1782481039.783885:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388226304 00000100:00100000:0.0:1782481039.783892:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388226304 00000100:00100000:0.0:1782481039.783923:0:14842:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388226432 00000100:00100000:0.0:1782481039.783927:0:14842:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388226432 00000100:00100000:0.0:1782481039.783960:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782481039.783966:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388226304:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.784003:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1869066388226304:12345-0@lo:400:kworker.0 Request processed in 38us (1871us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481039.784010:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1782481039.784020:0:14842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782481039.784026:0:14842:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388226432:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.784058:0:14842:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1869066388226432:12345-0@lo:400:kworker.0 Request processed in 34us (1834us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481039.784064:0:14842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1782481039.784085:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388226688 00000100:00100000:0.0:1782481039.784089:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388226688 00000100:00100000:0.0:1782481039.784115:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388226816 00000100:00100000:0.0:1782481039.784118:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388226816 00000100:00100000:0.0:1782481039.784131:0:14207:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388226560 00000100:00100000:0.0:1782481039.784134:0:14207:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388226560 00000100:00100000:0.0:1782481039.784156:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782481039.784162:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388226688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.784197:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1869066388226688:12345-0@lo:400:kworker.0 Request processed in 35us (2135us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481039.784203:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1782481039.784214:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782481039.784220:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388226816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.784247:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1869066388226816:12345-0@lo:400:kworker.0 Request processed in 28us (2078us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481039.784262:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1782481039.784272:0:14207:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1782481039.784278:0:14207:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7c67f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388226560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.784306:0:14207:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7c67f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1869066388226560:12345-0@lo:400:kworker.0 Request processed in 29us (2035us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481039.784312:0:14207:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1782481039.784345:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1782481039.784350:0:14203:0:(pinger.c:502:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1782481039.784363:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1782481039.784386:0:3313:0:(client.c:1905:ptlrpc_send_new_req()) Sending RPC req@ffff91d7dfa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388226944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782481039.784431:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1782481039.789677:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1869066388226560:0@lo:400:kworker.0 00000100:00100000:3.0:1782481039.789705:0:3312:0:(client.c:3111:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1782481039.789712:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff91d7fe9b6680, transno 8589934595 00000004:00080000:3.0:1782481039.789740:0:3312:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1782481039.789773:0:3312:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1869066388226432:0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.790749:0:14846:0:(service.c:2300:ptlrpc_server_handle_req_in()) unwrap req x1869066388226944 00000100:00100000:0.0:1782481039.790764:0:14846:0:(service.c:2365:ptlrpc_server_handle_req_in()) got req x1869066388226944 00000100:00100000:0.0:1782481039.790839:0:14846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782481039.790849:0:14846:0:(service.c:2551:ptlrpc_server_handle_request()) Handling RPC req@ffff91d7f4f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388226944:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1782481039.790905:0:14846:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00100000:0.0:1782481039.791001:0:14846:0:(service.c:2609:ptlrpc_server_handle_request()) Handled RPC req@ffff91d7f4f9a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1869066388226944:12345-0@lo:13:osp-pre-1-0.0 Request processed in 153us (6570us total) trans 0 rc 0/0 00000100:00100000:0.0:1782481039.791009:0:14846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1782481039.791417:0:3313:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7dfa55f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1869066388226944:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1782481039.797785:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1869066388226304:0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.797808:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1869066388226816:0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.797820:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:4df388c7-8b3f-4b0d-af2c-a76e2ecc7bcc:3310:1869066388226176:0@lo:400:kworker.0 00000100:00100000:0.0:1782481039.797832:0:3310:0:(client.c:2400:ptlrpc_check_set()) Completed RPC req@ffff91d7c67f5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1869066388226688:0@lo:400:kworker.0 00000001:00080000:3.0:1782481039.847686:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934615 is committed 00000001:00080000:3.0:1782481039.848045:0:5825:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:3.0:1782481039.848066:0:5825:0:(update_trans.c:60:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff91d7c622e840 refcount 2 committed 0 result 0 batchid 4294967528 00000020:00080000:3.0:1782481039.848094:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4fd2800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff91d7c622ee40 00000020:00080000:3.0:1782481039.848099:0:5825:0:(update_trans.c:68:top_multiple_thandle_dump()) st ffff91d7c4fd2300 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff91d6c29b9000 00000020:00080000:0.0:1782481039.848145:0:14246:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967528 committed batchid 8 00000020:00080000:0.0:1782481039.848511:0:14246:0:(update_trans.c:1581:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:3.0:1782481040.031817:0:14195:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 30153 lines, 30153 kept, 0 dropped, 0 bad.